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Milestones 
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Accomplishments 

Without  the  use  of  S-1000,  the  BBN  database  editing  tool,  a  BBN 
SIMNET  database  was  successfully  read  from  the  SIMNET  MCC 
Masscomp  into  a  Silicon  Graphics  Iris  Workstation.  A  patch  of  terrain 
was  displayed  and  a  computer  generated  car  was  driven  over  the 
terrain. 

Discussions  were  held  with  sponsors,  colleagues,  and  graduate 
students  on  the  research  approach,  design,  and  implementation  of 
automatic  feature  extraction  algorithms.  Drs.  Shah  (UCF)  and  Bowyer 
(USE)  will  begin  research  1  May  90. 

The  public  domain  image  processing  toolkit  from  U  of  Waterloo  was 
successfully  installed  into  the  SG  Iris. 


Problems 

The  database  which  was  ported  to  the  SG  Iris  was  a  Plan  View 
database,  as  opposed  to  the  CIG  database,  which  contains  -the  color 
and  texture  information  and  is  loaded  on  the  image  generator. 
Without  the  file  format  of  the  CIG  database,  it  cannot  be  changed.  A 
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verbal  request  was  made  to  Col.  Szymanski  (3/19/90)  to  obtain  the 
CIG  database  file  format  (and  also  S-10001. 


Additonal  contact  with  NTSC  was  made  by  Doug  Wood  contacting 
Julie  Cameron  for  the  CIG  database  file  format  (3/30/90). 
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Project  Monthly  Report  -  March  1990 
Multiple  Image  Generator  Databases 
Principal  Investigator:  Michael  Moshell 

Milestones 

•  Acquire  E&S  Tools 

•  Acquire  S-1000  Tools 

•  Design  the  MIDB  Tool  Suite 

Accomplishments 

(1)  On  22  March,  during  a  visit  to  NASA-Ames,  Dr.  Moshell  visited 
Software  Systems  in  San  Jose.  Software  Systems  produces  MULTI-GEN, 
which  is  the  only  generic  database  development  tool  for  image  generators 
currently  on  the  market.  MultiGen  produces  as  its  output  a  generic  file  '  ' 
format  titled  Flight,,  which  is  then  translated  into  the  specific  database 
format  of  various  IG's  by  formatter  programs. 

Software  Systems'  president  Dennis  Yeo  offered  to  donate  an  installation  of 
the  software  (worth  $24,000)  to  1ST  on  the  condition  that  we  receive 
permission,  in  writing,  from  Evans  &  Sutherland  to  construct  a  formatter 
from  Flight  format  to  ESIG-500  format,  and  that  we  place  this  software  in 
the  public  domain. 

(2)  Dr.  Moshell  immediately  wrote  a  memo  to  Mike  Hassom  and  Jim  Bleak 
at  E&S,  requesting  permission  to  do  same,  since  the  development  of  such  a 
formatter  was  in  any  case  already  part  of  our  funded  work  under  the 
present  Task  of  the  BAA. 

(3)  Xin  Li,  Curtis  Lisle  and  Jinxiong  Chen  have  continued  to  learn  the 
operations  of  the  ESIG-500  imap  generator  and  its  database  formats.  A 
non-paid  yolxmteer.  Dr.  Kate  Kinsley  from  UCF  Computer  Science,  has  also 
been  reading  the  manuals  and  familiarizing  herself  with  the  system  in 
anticipation  of  working  with  us  in  a  learning  mode  on  the  MEDB  task.  Dr. 
Kinsley  gave  a  colloquium  talk  on  12  March  as  part  of  the  weekly  VSL  staff 
meeting  on  the  subject  of  the  ESIG’s  database  format. 

Problems 

(1)  E&S  tools'  order  is  presently  ready  to  ship  at  Salt  Lake  City,  pending 
agreement  between  E&S'  lawyers  and  UCF's  lawyers  on  the  terms  of  the 
license  agreement.  A  standard  exclusion  in  Florida  law  is  that  the  state  is 
unwilling  to  indemnify  and  hold  harmless"  a  software  vendor,  which  is  a 
clause  that  often  turns  up  in  license  agreements.  E&S  must  now  accept  this 
rather  minor  change  to  the  license  agreement. 
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(2)  The  SIMNET  S-1000  tools,  which  are  supposed  to  come  to  us  via  ETL,  are 
still  unavailable  although  an  E-Mail  message  from  George  Lukes  indicked 
that  they  would,  at  last,  be  forthcoming. 

(3)  Delays  in  receiving  the  present  cycle  of  IQC  funding  have  in  turn 
prevented  a  necessary  maintenance  call  for  the  ESIG,  which  is  having 
some  microcode  problems.  Curt  Lisle  believes  that  the  problem  is  an  update 
of  the  microcode  which  was  shipped  to  us  to  modify  the  scan  rate  from  50  hz 
to  60  hz,  and  he  is  attempting  to  restore  the  50  hz  microcode  to  verify  that 
this  new  code  is  buggy. 

If  this  measure  does  not  restore  the  ESIG's  operation,  then  a  paid  E&S 
service  call  will  be  necessary. 


-4/25/90 
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Monthly  Report  -  April  1990 
Geospecific  Databases  Project 
Acting  Project  Lead:  Ron  Klasky 
Accomplishments 

1)  Two  meetings  with  Drs.  Mubarak  Shah  (UCF-CS)  and  Kevin  Bowyer 
(USF-CS,  Tampa)  were  held,  in  which  work  plans  for  the  joint 
research  in  stereo  extraction  were  made.  This  work  will  begin  in  May 
1990.  Drs.  Shah  and  Bowyer  will  select  and  train  the  appropriate 
student  employees  during  April. 

Dr.  Shah  will  concentrate  his  efforts  on  pixel-level  mathematical 
techniques  for  extracting  features  such  as  edges  and  regions  from 
video  and  photographic  imagery.  Dr.  Bowyer's  research  will  focus  on 
taking  feature  data  such  as  edges  and  matching  them  in  topological 
space  against  a  priori  models  such  as  prismatic  (parallelepiped) 
structures  for  buildings.  Thus,  Shah's  output  serves  as  Bowyer's  input 
(although  they  can  pursue  the  research  in  parallel). 

Both  components  of  the  team  will  develop  literature  searches  and 
collections  of  existing  software  for  1ST  staff  to  use  in  building  the 
first  demonstration  database.  Subsequent  (calendar  1991) 
demonstrations  will  be  based  on  a  mixture  of  off  the  shelf  and 
project-generated  algorithms. 

2)  Photographic  imagery  was  obtained  from  the  Army  of  Indian 
Springs  AFB;  contacts  were  made  with  commercial  firms  in  Tampa 
and  other  Central  Florida  locations  to  locate  a  simple  and  reliable 
vendor-path  for  imagery  scanning.  At  month's  end,  this  quest 
continues. 

Problems 

No  major  problems.  This  work  begins  in  earnest  in  May. 


Kultiple  IJ  Databases  Project 


Monthly  Report:  April  1990 

Project  Lead:  Ron  Klasky 

Milestones 

•  Attempted  to  develop  software  to  read  SIMNET  CIG  Database 

•  Modify  Li's  software  to  manipulate  SIMNET  terrain  with  bulldozer 

•  Received  Defense  Mapping  Agency  ITD  (Interim  Terrain  Database) 
data 


Accomplishments 

Using  the  SIMNET  Plan  View  Database,  the  bulldozer  software  was 
ported  to  dig  up  SIMNET  data  using  techniques  in  dynamic  terrain 
and  micro  terrain. 

Work  was  initiated  to  read  a  SIMNET  CIG  database,  again  without  the 
use  of  BBN's  SIOOO  package.  Work  looked  promising  at  first,  but 
then  reached  a  standstill  when  the  file  structure  no  longer  matched 
the  structures  defined  in  the  documentation  recently  made  available 
by  BBN  to  1ST. 

Work  has  begun  on  bringing  the  DEC  VAXstation  3100  up  and  on  the 
Visual  Lab's  Ethernet.  The  3100  will  be  home  to  the  Evans  &  Sutherland 
Database  Modeling  Tools  once  they  arrive,  which  is  expected  shortly. 


Problems 

For  any  further  work  on  BBN  SIMNET  databases  the  software 
package  S-1000  must  be  obtained.  If  it  cannot  be  obtained  than  any 
plans  for  doing  anything  with  the  SIMNET  databases,  aside  from 
displaying  them,  should  be  scrapped. 
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Monthly  Report  -  May  1990 
Multiple  IG  Databases  Project 
Project  Lead:  Michael  Moshell  (Acting) 

Accomplishments 

(1)  MultiGen  was  donated  by  Software  Systems  (San  Jose,  CA)  and 
installed  on  the  Iris  workstation.  This  $38,820  donation  materially 
enhances  VSL's  capability  to  develop  multiple-IG  databases  and 
conduct  research  into  semi-automated  correlation  technology. 

(2)  The  ESIG  tools  arrived,  and  were  installed  on  VAXstation  3100. 
PROBLEMS: 

A  number  of  difficulties  arose  with  the  VAXstation  installation  of  the 
ESIG  tools,  relating  to  the  lack  of  specific  system  utilities  in  the 
proper  version  to  work  with  the  ESIG  basic  graphic  toolset. 

The  reason  for  these  difficulties  is  that  Evans  and  Sutherland 
ordinarily  sells  the  VAXstation  along  with  the  tool  software;  thus, 
they  had  the  chance  at  Salt  Lake  to  integrate  the  software.  In  the 
case  of  VSL,  we  inherited  the  VAXstation  from  the  DARPA  project. 

This  cost  savings  of  around  $12,000  has,  however,  resulted  in  the 
loss  of  time  and  increased  effort  at  getting  the  ESIG  tools  in  place  and 
working. 


Monthly  Report  -  May  1990 
Geospecific  Databases  Project 
Project  Lead:  Ron  Klasky  (Acting) 

Accomplishments 

(1)  Annotated  bibliographies  were  constructed  in  the  areas  of  stereo 
algorithms  (SHAH)  and  shadow  extraction  (BOWYER),  as  per  the  time 
line.  These  reports  were  provided  to  the  sponsors  as  part  of  the 
briefing  notes  from  the  12  June  quarterly  progress  briefing  and 
demonstration. 

(2)  Task  definitions  were  more  sharply  focused.  Correspondence  with 
David  McKeown  at  Carnegie  Mellon  established  which  of  his 
algorithms  and  images  were  available  for  our  use. 

(3)  Specifications  were  established  for  the  magnetic  tape  drive  for 
reading  DMA  data.  Upon  receipt  of  the  IQC  funding,  this  drive  was 
requisitioned. 

PROBLEMS: 


None  at  present. 
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In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress,  Status 
and  Management  Reports  and  Cost  Reports  for  Task  1  and  2  for  the  May  1990  time  period  are 
forwarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  call  me  at  658-5014  or  658-5000. 


Sincerely, 


imi^5mart 
Program  Manager 
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Monthly  Report  -  July  1990 
Geospecific  Databases  Project 
Project  Lead:  Ron  Klasky  (Acting) 

Accomplishments 

(1)  Shah  and  Bowyer  have  applied  a  second  stereo  matching 
algorithm  to  the  test  datasets  they  are  using  (Los  Angeles  Airport) 
and  are  measuring  its  performance. 

(2)  Ray  Green  has  provided  1ST  with  information  about  several  map 
products,  which  include  USGS  high  altitude  photo  series  which  can 
serve  as  sources  of  stereo  imagery  of  Indian  Springs  AFB, 

(3)  Moshell  has  discussed  with  George  Lukes  the  architectWe  and 
structure  of  the  TIES  workstation  system,  and  its  availability,  so  that 
Moshell  can  construct  a  Materials  Requirement  in  early  August  for 
submission  to  Ray  Green.  In  brief,  the  results  are  as  follows: 

•  TIES  consists  of  two  pieces:  IDS  and  DSPW. 

•  Image  Digitizing  System  (IDS)  -  the  high  powered  scanning 
system,  being  built  by  InterGraph.  Will  cost  around  $300,000 
per  installation. 

•  Digital  Stereo  Photographic  Workstation  (DSPW)  -  a  gussied- 
up  Sun/4  workstation,  with  special  purpose  stereo  extraction 
and  display  boards  in  it  and  a  lot  of  software,  representing 
state  of  the  art  in  ortho  photo  correction  etc.  Output  will  be 
appropriate  for  input  into  Arcinfo.  DSPW  will  cost  around 
$225,000.  Arcinfo  will  cost  around  $36,000. 

DSPW  is  in  factory  acceptance  now,  will  be  (supposedly) 
delivered  in  early  September  to  ETL.  IDS  will  be  in  test  in  mid- 
August,  delivered  in  late  September. 

George  Lukes  recommends  against  our  getting  IDS,  offers  to 
work  out  a  deal  to  scan  images  for  us  when  hard  copy  is 
involved.  I  agree;  having  a  $300,000  machine  in  house  for 
occasional  use  is  not  a  good  investment. 


- 1  - 


George  Lukes  gave  us  the  name  of  the  ETL  engineer  in  charge  of 
TIES,  so  that  we  can  secure  more  information  in  pursuit  of  the 
development  of  a  formal  Materials  Requirement. 

PROBLEMS:  None  at  the  moment. 
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Monthly  Report  -  July  1990 
Multiple  IG  Databases  Project 
Project  Lead:  Michael  Moshell  (Acting) 

Accomplishments 

(1)  Two  Personal  Iris  computers  were  received  and  installed.  These 
machines  are  to  be  used  for  the  S-1000  toolkit  and  the  MultiGen 
toolkit,  respectively. 

(2)  Both  toolkits  were  installed  on  their  proper  Iris  machines.  Larry 
Brown,  who  took  the  S-1000  training  course  at  ETL  during  July,  is 
now  working  to  get  some  bugs  out  of  S-1000  which  presently 
prevent  its  use  on  the  Personal  Iris,  apparently  due  to  some 
mismatches  between  the  graphics  libraries  there  and  on  the  4D70. 

Worst  case  will  be  that  we  will  have  to  use  the  S-1000  tools  on  the 
4D70  workstation.  It  is  better  suited  for  projects  requiring  its 
realtime  capabilities. 

(2)  Ron  Klasky  attended  the  IMAGES  conference,  made  a  number  of 
contacts  in  the  image  generator  world.  While  there  he  negotiated 
with  Software  Systems  (providers  of  MultiGen)  and  1ST  has  now 
agreed  to  serve  as  the  repository  for  all  public  domain  Fliglit  format 
databases  (produced  by  MultiGen).  This  increases  our  access  to 
simulation  databases  for  a  variety  of  purposes. 

(3)  J.  Morie  analyzed  the  data  formats  from  the  S-1000  and  Flight 
systems,  and  is  building  a  matrix  of  features  and  capabilities  as  part 
of  an  overall  analysis  of  how  the  MIDB  task  should  be  pursued. 

(4)  Chen  Jinxiong  took  a  one-week  course  in  the  VMS  operating 
system  from  Digital  Equipment  Corporation,  in  order  to  facilitate  his 
work  with  the  ESIG-500's  database  management  suite  of  software. 

(5)  Chen  Jinxiong  extended  the  Research  Park  database  produced  by 
Ron  Klasky,  in  order  to  insert  specific  features  and  see  the  resulting 
data  structures  in  the  Flight  database.  This  work  is  preparatory  to 
building  the  Flight  ->  ESIG  formatter  program. 


PROBLEMS:  The  software  provided  by  Evans  &  Sutherland  continues 
to  malfunction.  Klasky  and  Chen  were  in  daily  dialog  with  E&S 
through  much  of  July.  At  present  (1  August)  Klasky  is  spending  two 
weeks  in  Salt  Lake  City  to  learn  more  about  how  to  solve  these 
problems  and  to  take  a  general  course  in  ESIG  database  building. 

Klasky’s  travel  and  his  labor  are  being  paid  for  by  DARPA,  as  part  of 
the  collaborative  effort  to  get  the  ESIG  functioning  for  the  DARPA 
SAP  project  and  the  PM-TRADE  MIDB  project. 
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TASK  1 :  Rapid  Production  of  Geospecific  Databases 
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Monthly  Report  -  Aug  1990 
Geospecific  Databases  Project 
Project  Lead:  Brian  Blau 
Accomplishments 

1)  New  graduate  assistant  Chuck  Campbell,  and  new  Project  Manager 
Brian  Blau,  worked  to  build  3d  visualization  tools  on  Silicon  Graphics 
which  display  the  disparity  maps  computed  by  Shah's  stereo 
algorithms  as  real  3d  perspective  images.  Demos  are  now  available. 

2)  Shah,  Bowyer,  Blau,  Campbell,  Bowyer’s  student  Maha  Sallam  and 
Moshell  met  on  28  Aug.  in  Orlando  to  discuss  plans  for  fall  semester. 
A  Florida  High  Tech  proposal  is  being  developed  to  extend  the  work 
on  stereo  and  shadows,  to  achieve  a  "force  multiplier"  with  the 
Federal  dollars. 

Plans  were  made  for  an  interactive  CAD-style  shadow  image 
extraction  program  to  be  built  during  the  fall  semester  by  Maha 
Sallam.  We  also  discussed  the  needs  for  realistic  imagery  for  the 
production  of  a  demo  database  during  the  fall  of  1990,  and 
considered  the  parameters  for  photography. 

One  thing  which  Shah  and  Bowyer  have  repeatedly  mentioned  is  that 
table-top  imagery  (i.e.  "point  a  TV  camera  at  some  models")  has 
advantages  over  real-world  imagery  in  that  it's  easy  to  measure 
precise  camera  positions  and  "building"  sizes,  etc.  Should  we  fly  over 
Ft.  Rucker,  it's  hard  to  position  the  cameras  precisely  in  the  inverse 
image  transformations  necessary  to  ortho-rectify  the  imagery. 

Chuck  Campbell  was  tasked  to  become  expert  on  cartographic 
imagery  and  to  report  back  on  the  camera  specs  needed  to  get  good 
imagery  for  stereo  reconstruction  of  our  demo  database. 

3)  Maha  Sallam  and  Kevin  Bowyer  provided  an  extended  version  of 
their  earlier  survey  paper  on  shadow  based  methodology  (attached). 

PROBLEMS:  None  at  the  moment. 
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Monthly  Report  -  August  1990 
Multiple  IG  Databases  Project 
Project  Lead:  Michael  Moshell  (Acting) 
Accomplishments 


(1)  Chen  and  Klasky  have  succeeded  in  getting  the  ESIG  database 
tools  to  work,  and  have  constructed  a  small  model  of  a  house  with 
1ST  on  the  roof,  and  installed  it  into  an  ESIG  database  and  flown  over 
it. 

(2)  Jacki  Morie  has  constructed  a  matrix  summarizing  the  salient 
features  of  MultiGen,  S-1000  and  ESIG  databases  as  a  starting  point 
for  the  design  of  the  formatters  necessary  to  move  between  the 
various  formats.  A  copy  of  that  matrix  is  attached. 

(3)  New  versions  of  MultiGen  were  received  and  installed. 
Unfortunately  these  versions  lacked  the  DTED  and  DEAD  input 
options,  and  so  we  continue  to  use  the  old  versions  until  they  send  us 
the  fully  capable  new  code. 

(4)  The  9  track  tape  drive  arrived  and  was  installed,  so  we  can  now 
read  anyone's  DMA  DTED  and  DEAD  tapes  without  hindrance  and 
install  their  information  into  databases,  using  MultiGen. 

(5)  Curt  Lisle  has  been  hired  as  a  new  fulltime  1ST  employee  and  will 
assume  command  of  this  project  when  he  returns  from  his 
honeymoon  on  17  September. 

PROBLEMS 

S-1000  tools  seem  to  be  quite  difficult  for  Larry  Brown  to  install;  he 
still  doesn't  have  a  working  system.  We  are  looking  for  ways  to 
employ  some  E&S  people  and  time  so  as  to  have  some  on-site 
assistance,  and  perhaps  to  build  a  good-sized  piece  of  terrain  from  Et. 
Rucker  (see  Moshell,  Smart  &  Goldiez'  trip  report  from  Rucker  this 
month  for  details). 
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ISuiKlinr,  I  rar  t  i  >111  via  StiTeojisis  /  ^;llall  /  i'Cl-  / 
Uriel  .summary  of  'lolley's  Stereo  Kxtraetion  Al);oritlim 


Algorithm  based  on  the  paper  "Detection  of  Binocular  Disparitie 
by  K.  Prazdny. 


The  algorithm  for  the  stereo  program  compares  two  edge  maps  and 
disparity  map  of  matching  points,  shading  pixels  according  to  their  disn 
The  shade  of  gray  is  scaled  according  to  the  range  of  the  disparity  c'r.e'c 
Thus,  if  a  disparity  of  +/-  6  is  checked,  the  resulting  picture  would 
(potentially)  contain  thirteen  shades  of  gray.  Pixels  shifted  to  the  ric 
light  gray,  to  the  left  dark  gray,  and  pixels  that  match  exactly  are  a 
m.iddle  shade  of  gray.  For  example,  evaluating  a  Sobel  edge  map  of  the 
Pentagon  picture  at  disparity  6  produces  gray  scale  values  of  18  for  -5 
disparity,  23  at  +6,  and  126  for  a  disparity  of  zero. 

The  program  builds  the  disparity  map  by  scanning  the  left  irnace 
edge  points,  then  searching  the  right  image  for  possible  matches.  It  mar 
all  possible  disparities  within  the  search  range  for  each  point  in  the-  a 
and  then  evaluates  these  multiple  choices  to  find  the  most*  probable  m.atc 
Gaussian  distribution  function  weighs  support  values  for  each  possible 
disparity,  taking  in  account  evidence  from  neighboring  potential  matches 
similar  disparity.  After  each  disparity  has  been  decided,  a  gray  scale 
is  produced  from  the  disparity  map,  shading  the  points  with  a  value 
proportional  to  its  disparity. 
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The  essence  of  the  project  task  is  to  evaluate  the  state  of  the  art 
in  automated  methods  for  using  shadows  in  aerial  images  to  e;:tract 
the  height  of  buildings,  and  possibly  other  cultural  features. 

(**  Be  sure  to  let  me  know  if  I  have  anything  wrong  at  this  level!) 
Accordingly  the  first  two  subtasks  are  (1)  to  gain  an  intellectual 
understanding  of  the  state  of  the  art  by  conducting  a  thorough 
literature  review  and  summarizing  the  results  in  a  review  paper,  and 
(2)  to  gain  a  more  intuitive  feel  for  the  state  of  the  art  b*y  actually 
implementing  some  of  the  methods  discussed  in  the  literature  and 
independently  evaluating  their  performance  in  our  laboratory.  The 
completion  of  these  two  subtasks  will  bring  us  to  the  point  where 
we  can  reasonably  specify  the  parameters  of  some  capability  in  this 
area  to  be  delivered  to  1ST. 

The  literature  review  is  approximately  90%  complete.  I  have  made 
already  made  corrections  and  suggested  additions  on  a  draft  which 
covers  the  complete  breadth  of  the  project.  I  e.xpect  to  review  the 
the  resulting  draft  within  the  next  week  and  send  a  copy  to  1ST  for 
review  in  approximately  two  weeks.  The  review  will  cover  the  use 
of  shadows  as  an  image  cue  generally,  as  well  as  the  specific  task 
of  recovering  building  height. 

In  preparation  for  evaluating  some  of  the  methods  described  in  the 
literature,  we  have  been  contacting  the  authors  of  what  we  feel  are 
the  more  important  papers  and  asking  them  for  copies  of  the  images 
used  to  illustrate  the  methods  in  their  papers. 

We  have  obtained  the  images  used  in  the  paper  by  Nevatia  (Heurtas  and 
Nevatia,  "Detection  of  Buildings  in  Aerial  Images  Using  Shape  and  Shadows," 
8rth  International  Joint  Conference  on  Artificial  Intelligence, 

1983.  Longer  version  also  in  CVGIP.) 

We  contacted  Professor  Pavlidis,  but  he  was  unable  to  supply  us  with 
the  images  used  in  his  paper  due  to  his  student  having  graduated  and 
his  not  being  able  to  find  the  images  (Liow  and  Pavlidis, 

"Use  of  Shadows  for  Extracting  Buildings  in  Aerial  Images," 

CVGIP  49,  242-277,  1990).  This  paper,  anyway,  did  not  direccly  address 
the  question  of  estimating  height  of  buildings. 

We  have  also  contacted  David  McKeown  at  Carnegie-Mellon  University. 

(Irvin  and  McKeown,  Methods  for  Exploiting  the  Relationship 
Between  Buildings  and  Their  Shadows  in  Aerial  Imagery. 

Systems,  Man,  and  Cybernetics  19,  1564-1575,  1989) . 

He  has  been  quite  helpful  in  supplying  us  with  reprints  and  technical 
eports  describing  his  work.  We  have  not  yet  received  the  images 
e  has  used,  but  he  has  promised  to  send  the  images,  along  with  an 
independent  measuremient  of  the  ground  truth  and  an  accompanying 
technical  report,  as  soon  as  the  whole  package  is  complete. 
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Algorithm  based  on  the  paper  "Detection  of  Binocular  Disparities" 
by  K.  Prazdny. 


The  algorithm  for  the  stereo  program  compares  two  edge  maps 
disparity  map  of  matching  points,  shading  pixels  according  to  their 
The  shade  of  gray  is  scaled  according  to  the  range  of  the  disparity  checked.” 
Thus,  if  a  disparity  of  +/-  6  is  checked,  the  resulting  picture  would 
(potentially)  contain  thirteen  shades  of  gray.  Pixels  shifted  to  the  right  ar 
light  gray,  to  the  left  dark  gray,  and  pixels  that  match  exactly  are  a 
middle  shade  of  gray.  For  example,  evaluating  a  Sobel  edge  map  of  the 
Pentagon  picture  at  disparity  6  produces  gray  scale  values  of  18  for  -6 
disparity,  23  at  +6,  and  126  for  a  disparity  of  zero. 

The  program  builds  the  disparity  map  by  scanning  the  left  image  for 
edge  points,  then  searching  the  right  image  for  possible  matches.  It  marks 
all  possible  disparities  within  the  search  range  for  each  point  in  the  array, 
and  then  evaluates  these  multiple  choices  to  find  the  most*  probable  miatch.  *  .A 
Gaussian  distribution  function  weighs  support  values  for  each  possible 
disparity,  taking  in  account  evidence  from  neighboring  potential  matches  of 
similar  disparity.  After  each  disparity  has  been  decided,  a  gray  scale  imag 
is  produced  from  the  disparity  map,  shading  the  points  with  a  value 
proportional  to  its  disparity. 
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The  essence  of  the  project  task  is  to  evaluate  the  state  of  the  art 
in  automated  methods  for  using  shadows  in  aerial  images  to  e;:tract 
the  height  of  buildings,  and  possibly  other  cultural  features. 

(**  Be  sure  to  let  me  know  if  I  have  anything  wrong  at  this  level!) 
Accordingly  the  first  two  subtasks  are  (1)  to  gain  an  intellectual 
understanding  of  the  state  of  the  art  by  conducting  a  thorough 
literature  review  and  summarizing  the  results  in  a  review  paper,  and 
(2)  to  gain  a  more  intuitive  feel  for  the  state  of  the  art  by  actually 
implementing  some  of  the  methods  discussed  in  the  literature  and 
independently  evaluating  their  performance  in  our  laboratory.  The 
completion  of  these  two  subtasks  will  bring  us  to  the  point  where 
we  can  reasonably  specify  the  parameters  of  some  capability  in  this 
area  to  be  delivered  to  1ST. 

The  literature  review  is  approxim.ately  90%  complete.  I  have  made 
already  made  corrections  and  suggested  additions  on  a  draft  which 
covers  the  complete  breadth  of  the  project.  I  expect  to  review  the 
the  resulting  draft  within  the  ne:-:t  week  and  send  a  copy  to  1ST  for 
review  in  approximately  two  weeks.  The  review  will  cover  the  use 
of  shadows  as  an  image  cue  generally,  as  well  as  the  specific  task 
of  recovering  building  height. 

In  preparation  for  evaluating  some  of  the  methods  described  in  the 
literature,  we  have  been  contacting  the  authors  of  what  we  feel  are 
the  more  important  papers  and  asking  them  for  copies  of  the  images 
used  to  illustrate  the  methods  in  their  papers. 

We  have  obtained  the  images  used  in  the  paper  by  Nevatia  {Keurtas  and 
Nevatia,  "Detection  of  Buildings  in  Aerial  Images  Using  Shape  and  Shadows," 
Srth  International  Joint  Conference  on  Artificial  Intelligence, 

1983.  Longer  version  also  in  CVGIP.) 

We  contacted  Professor  Pavlidis,  but  he  was  unable  to  supply  us  with 
the  images  used  in  his  paper  due  to  his  student  having  graduated  and 
his  not  being  able  to  find  the  images  (Liow  and  Pavlidis, 

"Use  of  Shadows  for  Extracting  Buildings  in  Aerial  Images," 

CVGIP  49,  242-277,  1990).  This  paper,  anyway,  did  not  direcoly  address 
the  question  of  estimating  height  of  buildings. 

We  have  also  contacted  David  McKeown  at  Carnegie-Mellon  University. 

(Irvin  and  McKeown,  Methods  for  Exploiting  the  Relationship 
Between  Buildings  and  Their  Shadows  in  Aerial  Imagery. 

Systems,  Man,  and  Cybernetics  19,  1564-1575,  1989) . 

He  has  been  quite  helpful  in  supplying  us  with  reprints  and  oechnical 
reports  describing  his  work.  We  have  not  yet  received  the  i.m.ages 
he  has  used,  but  he  has  promised  to  send  the  images,  along  with  an 
independent  measuremient  of  the  ground  truth  and  an  accompanying 
technical  report,  as  soon  as  the  whole  package  is  complete. ' 


Uso  of  Shadows  In  Image  Understanding 
(08/28/1990  Draft) 

Maha  Sallain  and  Kevin  Bo\vy(;r 
Departnieiit  of  Computer  Science  and  Engineering 
.  Universit}^  of  South  Florida,  Tampa,  Florida  33G20 

1  INTRODUCTION 

linage  interpretaLioii  is  an  essential  step  in  several  practical  a.pi)rK:ations.  In  the  area  of  inorh']- 
ing  and  simulation,  2-diinensional  images  often  comprise  the  only  source  of  infoi  niation  about  a 
real  world  location  lor  which  a  model  is  needed.  The  science  of  aerial  photography  has  advaiuc'd 
greatly  in  the  past  lew  years  and  much  ol  the  equiinnent  usi'd  in  taking  t  he  actual  photographs 
has  liecome  highly  automated.  However,  the  art  ol  aerial  phot-ogiaph  interpretation  is  still 
highg'  manual  and  primitive  in  comparison.  Finding  a  way  of  automatically  e.x'tracl.ing  the 
inlormation  available  in  2-dimensional  images  can  save  an  enormous  amount  of  time  and  effort. 
'I  he  problem  of  automating  the  jiiocess  of  aerial  photograjih  inteigretation,  though  dirficult. 
is  not  impossible  to  solve.  Indeed,  numerous  researchers  have  already  e.xplored  many  flifferent 
aspects  of  the  problem  [1 , 2,  3,  d,  5].  Many  of  the  basic  image  processing  and  interpretation  t.ech- 
niiiues  used  in  Computer  Vision  can  be  applied  to  aerial  photographs,  especially  photographs 
ol  urban  and  suburban  areas.  Shadows  play  an  important  role  in  the  piocess  of  interpreting 
2-dimeri,sional  images.  The}'  have  been  used  to  serve  several  purposes  that  range  from  detecting 
tJie  e.xistence  ol  3-dimensional  objects  to  estimating  fairly  accurate  ciualitativc  and  (plant, it, ative 
h.-atures  of  obj<.-cts  in  a,n  image  [1, 2,  3,  d). 

The  difficulty  ol  interpreting  2-dirnensional  imagois  of  3-dimcnsional  objects  lies  mostly  in 
losing  the  third  dimension  information.  Shadows  can  be  viewed  to  be  t  he  pi'ojectioii  of  this  l.hird 
dimension  onto  the  plane  of  the  2-di?n<nisiona.l  view  and  can  be  used  t.o  e.xtract  object  feat.uies 
that  are  not  explicitly  available  in  their  ima.g(‘s.  For  shadows  to  be  of  value  in  calculat.ing  some 
of  the  features  tlu^y  reflect,  information  must  be  available  about  the  .source  of  illumination 
causing  tluise  shadows.  In  aerial  images  obtained  on  sunny  days,  the  source  of  illumination 
causing  shadows,  the  sun,  is  very  well  understood.  By  knowing  tin'  date  and  time  of  an  aeiial 
|)hotograph,  the  location  of  the  sun  with  rcjspect  to  Earth  can  be  accurately  calculated.  In 
this  report,  we  present  a  discussion  of  previous  work  which  concentrated  on  how  shadows  can 
provide  information  in  an  aerial  image.  We  also  explore;  vvoik  that  us(xl  shadows  to  calculate 
leatures  of  buildings  that  cannot  be  directly  measuix^d  in  an  a.eria.l  image,  such  as  the  height  of 
a  building. 

2  THEORETICAL  STUDIES 

.As  general  background,  this  s(;ction  provides  a  |•(;vi(;w  of  previous  theoretical  work  eleaiing  with 
th(‘  relat.ionship  between  objects  and  their  slnulows  in  images.  We;  I'efer  t,o  the  work  reviewed  in 
this  sf'ct.ion  as  ’’theore't.ical”  because  no  i(;al  images  an'  aual3''/(«(l.  'The  input  to  the  algorilhms 


<l('S(  ril)<‘(|  In'i'c  is  ;issumc(l  l.o  lx-  (‘il.lx'r  .‘i.  (•<>iii|)l<‘l.<'  cxl.i-acicd  lint;  drawing,  or  a  lahohsl  liiir' 
(Irawiiig  l.lial,  rcpn.'sr'iil.s  (|ualil.al,iv(!  imdrislaiKliiig  of  Uio  scene  in  lenns  of  llie  basic  sliapo  and 
position  of  ob  jects. 

In  chapter  two  of  tin-  book  tith'd  ”  'I'Ik'  Psychology  of  Computer  Vision"  ffij  ,  l)a\'id  Waltz 
providers  a.  discii.ssion  ol  e.xtractiiig  sliaelows  and  reconstructing  three  iliinensiona!  models  from 
th(;ir  2-dimensional  line  drawings.  In  this  stiuiy,  ati  almost  complete  catalog  of  labeds  for  the 
possible  t3'[)c.s  ol  lines  and  verticers  that  ca.n  exist  in  a  line  drawing  is  pi’ovided.  A  set  of  working 
programs  that  attempt  to  assign  a  nniepie  la.bel  to  each  line  and  vertex  in  a  line  drawing  is  als-) 
explored.  For  this  particular  sot  of  programs,  the  labeling  of  the  various  lines  and  x'ertice.'s  is 
based  mainly  on  geometric  constraints.  Limiting  the  number  of  labels  that  a  pai  ticnlar  vertex 
can  have  leads  to  imposing  constraints  on  adjacent  vertices.  By  increasing  the  constraint.s  \vc 
place  on  the  type  of  label  tliat  a  verte.x  can  have,  we  increa.se  the  possibilitj'  of  jrroducing  a 
unique  label  for  this  vertex.  Sahadows  in  this  case  present  an  im])ortant  source  of  additional 
((fust.ra.ints  that  can  l)e  imposed  on  lines  in  the  image.  Without  shadows,  the  idenlification  of 
parls  ol  (,he  objects  lelative  to  their  baxrkgi'ound  Irecomes  imj)ossible. 

.Anot.her  researcher  who  explored  the;  theme  ol  geometric  constraints  between  objeefs  and 
their  shadows  is  Sha.fer  in  his  book  ’’Shadows  and  Silhouettes  in  Comjiuter  Vision’’  [7].  In  this 
book,  the  relationship  between  illumination  source  positions,  ob  jects  and  the  shadows  they  cast 
is  explored.  Sha.fer  started  with  solving  what  he  called  the  ’’Basic  Sha.dow  Problem’’  and  went 
on  to  provide  solutions  for  progre.ssively  more  complex  scenes.  He  studied  scenes  of  multiple 
curved  objects  and  illumination  sources.  The  simplest  case,  oi'  the  ’’Basic  Shadow  Problem", 
occni's  when  a  single  polygon  casts  its  sliadow  on  the  background  due  to  a  single  source  of 
illumina.tion.  1  lie  solution  to  (his  problem  is  the  base  on  which  most  analj'sis  of  the  more; 
complicated  situations  in  the  book  was  built.  Although  this  particular  work  did  not  deal  witli 
real  images,  it  providiid  several  equations  a.nd  geojuetric  relations  that  can  be  valuable  when 
applied  to  shadow  information  extracted  from  real  images. 

HecentI}',  Singh  and  llamakrishna  [8]  expanded  the  work  done  by  Shafer  and  combined 
shadows  and  (.exture  to  find  the  shajK;  of  three  dimensional  objects  from  their  two  dimensional 
line  drawings.  J  hey  used  the  solution  to  the  ’’Basic  Shadow  Pioblem”  ])ioposcd  bN'  Shafei- 
to  lind  the  shape  and  orientation  ol  the  various  surfaces  of  a  pol^diedra  based  on  shadow 
geometiy.  They  also  introduced  a  method  for  finding  the  shape  of  curved  objects  by  calculating 
the  gradients  ol  |)ointson  the  surlaces  of  the.se  objects.  Their  calculations  were  based  on  shadow 
geometry  con.stra.ints  as  well  as  ti'xture. 


3  SHADOW  ANALYSIS  IN  REAL  IMAGES 

.Shadow  detection  should  not  be  viewed  as  an  indej)endent  stej)  which  precedes  obje-ct  ident  ifica¬ 
tion  in  tin;  proc(;.s.s  ol  image  intei-pretation.  In  fact,  pol,(;ntial  object  structnix'  areas  in  an  ai'rial 
phol.ograph  a.r<'  important  to  veril}'  the  existence  ol  shadows  in  ))olent.ial  shadow  atcas  and  \'ice 
versa..  Shadow  exti'action  is  a  complicated  process  which  is  alfected  by  many  \'ariables.  do 
reduce  tin;  (:om|)le.xity  ol  the  proce.ss,  r<;.searcher.s  have  im|)osed  certain  restiicl.ions  on  I  he  I  Apes 
ol  structiiri's,  and  l.he  inl.i'iisity  ol  the  shatlow  areas  rela.I.ive  l.o  oilier  c,ompon(;nl.s  in  ;m  aerial 
phol.ograph.  Huertas  and  Nevatia  [1, 2]  lor  example,  a.ssmiu.'d  (  hat  structures  to  be  det.eei.efl  in 


.•Ill  .'icrial  pliol.o^ra pli  cil  lici'  rccla ngiilaf  or  arc  ctiiiiposci!  of  r('(.-!,an^iil;ir  <-o!!i|)on.  iiS.  ! 
.■issuni|)(,i(ai  allowed  l.licin  l,o  liiid  shadows  hy  dcl.cci.iiii^  |)a,irs  ol  |)('r|)(’iidl('nlar  lino  si-mii'Sits 
ohiaincd  by  sonic  low  level  (>dge  di'l.c'cl.ioii  algoril.liin.  Oiiee  siieh  eoniers  lia\-e  been  delecji'd, 
lui'l.lier  analysis  is  perloiiiK.'d  based  on  (die  (lire(:(,ion  ol  (die  sun  illniiiinaldoii  and  (die  r('la (iona! 
|K)si(dons  of  pairs  ol  de(.ee(,cd  corners.  'The  boundaries  of  (die  red, angular  areas  in  (die  image  aic 
(hen  found  by  finding  Llie  gron|)s  ol  corners  UiaL  could  be  connecled  lo  form  a  coiiipleled  area 
boundary.  In  this  work  shadow  areas  are  not  segmented  out  in  the  actual  image,  but  ladiei. 
shadow  information  is  stored  as  a  part  of  each  corner  dcscri])tion.  Using  the  shadow  informa¬ 
tion  lor  ea.cii  corner,  tliey  decide  which  corners  are  likely  to  Ireloiig  to  a  structure  boundary  and 
which  are  likely  to  belong  to  a  shadow  boundary. 

Irvin  and  ^''IcKeown  [3]  introduced  a  more  comprehensive  approach  for  using  shadows  in 
aerial  photographs.  They  implemented  se])ara(.e  algorithms  for  each  of  the  various  stages  of 
the  aeriad  image  interpretation  process,  d'he  reason  for  diviiling  the  j^rocess  into  modules  is 
to  make  it  possible  to  combine  more  than  one  method  for  each  stage  of  tiuj  iiii,er|)rel,al  ion 
process.  For  the  stage  ol  shadow  exl.raction,  they  use  an  algorithm  that  finds  shadow  anais 
using  simjde  thresholding  and  region  growing  techniques,  .^n  average  shadow  intensity  value  is 
calculated  based  on  tlie  values  ol  the  pi.Kels  adjacent  to  all  the  potential  structure  areas  in  i  h.e 
image.  Only  (Jie  pixels  that  are  on  the  opposite  sitle  ol  the  ilhimiiia,tioii  source  are  considered 
since  this  is  the  side  where  shadows  have  to  be  if  they  exist.  The  calculaled  threshold  value 
is  l.hen  used  in  a  legion  growing  process  to  extract  the  shadow  areas  in  the  image.  So  fai-. 

(  his  method  does  not  impose  any  restrictions  on  the  shape  of  sti  uctiires  nor  their  shadows  in 
(  he  image.  Once  shadow  areas  have  been  extrac(.ed,  the  structure  side  segments  of  the  shadow 
boundaries  are  determined  using  knowledge  ol  the  direction  of  illumination.  'Pliese  segments 
are  (hen  extended  into  parallelograins, which  approximate  the  shapes  of  the  strucl.mcs  in  the 
image.  J  his  step  restrid.s  the  structures  that  can  be  de(,ec(,cd  in  an  aerial  image  to  parallelogram 
shaped  structures.  Irvin  and  Mcl\cowri  also  use  shadows  to  group  fragments  that  belong  (o 
the  same  structure  in  an  image  but  arc  sepa.rated  because  of  segmentation  errors,  d'he  idea  is 
that  there  is  usually  more  consistency  in  color  intensity  within  a  shadow  area  that  belongs  to  a 
certain  building  than  there  is  in  the  building  area  itseli.  This  reduces  the  chance  for  producing 
false  area  boundaries  within  the  shadow  area  during  .segmentation.  Based  on  this  assumption, 
all  the  separate  segments  that  ai'c  adjacent  to  the  illuminated  side  of  a  shadow  area  can  be 
grouped  into  one  large  segment  that  r<'pre.sents  tlie  building  which  cast  the  shadow. 

Scnnetimes  shadow  areas  can  be  used  as  a  source  of  information  without  being  explicit  1\' 
ex(.racted  in  an  image.  .Some  researchers  lound  it  useful  to  use  shadow  iuformatiori  at  the  Icwel 
ol  .segmentation  and  edge  detection  to  produce  more  reliable  structure  boundaries  in  the  image, 
biow  and  Pavlidis  [d]  introduced  two  methods  that  used  shadow/building  edges  as  an  initial 
source  ol  reliable  inlorination  lor  performing  edge  detection  and  region  growing.  3  he  resiills  of 
I  hose  methods  are  lar  better  than  an}'  sim|)lc  .segmentation  sclieme  becau.se  they  take  advanl.age 
ol  the  shar|)  intensity  of  edges  camsed  by  the  high  contrast  between  structure  areas  and  a.djaceiit 
shadows.  In  their  region  growing  algoril.hm,  they  use  the  jiixels  adjacent  t.o  a  sharp  (xlgc  which 
separates  a  structure  area,  from  its  shadow  area.,  'rhe.se  pixels  are  used  as  a  represenl  a!  i\'e 
sample  Irom  which  (.hey  calculate  (.he  a.v<-rage  inf.ensity  and  the  standard  dcwialioii  aiiKmg  .il! 
pix('ls  that  belong  (,o  (.his  structure  ar<-a,. 

I  hompson,  Cheeky  ami  Kaemmerer  (t)]  used  "shadow-stereo”  to  extract  objeci  lioimdaries 


ill  (Iiiiii‘iisi()ii;il  iin;ij-,cs.  In  iJicir  ;iii;ilysis  of  .'i  s<-<-iic,  llicy  use  two  sets  of  ini.iL'vs.  li  sr!  is 
l.jikcii  Iroin  ii  (1 1 llrmi 1 1.  <’aiii('i';i.  iiosil.ioii  ;iii<l  wil.lnii  <';u  li  set,  iinaycs  arc  ca | il.ii r<‘(l  ninlcr  dillcii'iil 
sources  ()1  illimiiiiat.ioii.  Ivigcs  t.lial.  arc  I'aiscd  iroiii  l.lic  groiiinl  such  as  t  hose  which  re|)r('se:it 
ohjecl,  l)oiiii<l;uics  are  (risl,iiigiiish(‘<l  IVom  edges  l.hal,  ar<M)n  l.he  ground  using  t  he  sleii'o  iina'ies, 
linage's  hakcii  imdci'  various  soiirex's  of  ilhimiiialion  are  used  (,o  idcnlilv  Uue  hoiindarv  ediK's 
which  would  jemaiu  in  I, lie  same  posit, iem  nigardless  ol' the  <lir('cl.iou  of  illumination.  Ol  hereihjes 
that  shift  in  position  depending  on  the  direction  of  ilinniination  arc  considered  to  Ik;  shadow 
houiidaiies.  Although  this  woik  did  not  use  aerial  photogra]>hs  as  a  source  of  input,  images, 
it  can  certaiidy  he  apiilied  to  aerial  images.  Of  cour.se,  we  cannot  change  the  direction  of  the 
source;  ol  illumination  (the  snn),  l)ut  we  can  take  several  stereo  images  at,  differe;nl,  t.imes  err  ex  e  n 
eni  eliflerent  dates  when  the  scene  location  change's  its  position  with  ix'spect  to  the  sun. 

As  we  mention(.‘d  earlier,  shadow  anal3'sis  cannot  be  used  as  an  independent  souice  of  infor¬ 
mation  in  the  interpretation  of  aei'ial  photographs.  The  use  of  sha,dows  should  be  an  integi  atee! 
|)arl.  erf  a  full  aerial  image  interpi  etation  .system.  Nagao,  M,atsuyama  and  Ikeela  in  trod  need  such 
svst.e'in  in  [10].  In  this  system,  all  I, he  various  regions  in  the  image  are  extracted  and  numbered, 
for  each  region  lound,  they  calculate  all  ol  the  properties  associated  with  that  legion,  such 
as  average  intensit}',  location,  shape,  etc.  Once  tliese  properties  have  been  calculated,  thev 
are  st.ored  along  with  tlie  region  number  in  a  table  which  they  call  ’’the  basic  propert\-  t.able”. 
'I'h('s('  calculated  properties  are  used  to  identify  the  vaiions  elements  in  the  actual  leal  woiid 
location  that  each  of  the  extracted  regions  in  the  image  represent.  In  this  system,  shadows  play 
I  h(;ir  traditional  role  ol  aiding  in  identifying  raised  structures  in  an  aerial  image.  To  extract  the 
shadow  regions,  th<;y  calculate  .some  threshold  value  of  brightnessbased  on  the  average  inten¬ 
sity  among  all  pixels  in  the  image.  All  regions  in  the  image  which  have;  brightness  lowc.'r  than 
the  calculated  thnrshokl  are  considered  to  be  shadow  regions.  Once  shadow  legions  have  been 
idenl.ified,  the  regions  which  are  adjacent  to  them  in  the  direction  of  tlie  snn  and  which  ha\'(; 
common  boarders  with  them  are  considered  to  be  regions  that  correspond  to  raised  structures 
in  the  image. 

Most  methods  which  have  been  imirlernented  so  far  are  dependent  on  various  assumjrtious 
and  restrictions  that  limit  their  performance  under  various  conditions.  Due  to  the  diffeienccs 
in  contrast,  illumination  and  quality'  of  various  aerial  images  many  systems  may  consider  some 
dark  non-shadow  areas  in  some  images  to  be  shadow  areas.  'J’his  problem  may  cause  a  false 
rietection  of  objects  or  structures. 

4  DETERMINING  THE  HEIGHT  OF  A  STRUCTURE 

Scientists  have  used  shadows  to  accurately  determine  the  lu'ight  of  buildings  in  a(;rial  image's 
[1,  2,  2,  II,  12].  I'hgure  1  shows  the  basic  i<lea  of  how  the  height  of  a  building  {131!)  can  be 
calculated  il  the  angle  ol  the  sun  elevation  with  respect  to  Earth  (x)  and  the  length  of  the 
shadow  {S L)  are  known.  The  following  e<|uation  describes  tin;  imirortant  relation: 

J3}1  ~  SJl  X  tan  X  ( 1 ) 

I  Ih'  length  ol  tin'  shadow  can  be  measured  directly  from  the  image.  In  general.  fiiKliiig  the 
angle' ol  th('  snn  elevation  r(;(|uires  a  .somewhat  more;  com irlicate'd  proce'ss.  .ccaii  Ik-  I'ouikI  using 
one'  e)l  t  he'  lolleiwing  ine'thoels: 
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I-  II  tli<’  ()l  ;in  ohjc'cl.  in  I.Ih*  is  ;i  Irts'idy  known,  I  lion  In’  nio.isnrini'  the  lii'iL'Ii! 

I.lio  sliiulow  which  I, his  ohjoct,  cn.sl.s  on  l.ho  l);t.ck!!;i’<>ninl,  wo  ciin  nso  o(|n;il.ion  I  lo  cnloiil.in' 
l.ho  .-inglo  X.  Onoo  I, he  value  ol  x  is  known,  i(.  can  he  used  t.o  ca.icniat.o  oiJior  unknown 
ohjecL  heights,  'riu-  prohJcnn  witli  I, Ids  m<d,hod  is  that,  it,  lauiuires  some  prior  knowledge 
ahoiit  the  image  which  is  not  always  a.vailal)le.  Also  th('  chance  foi’  oi  ror  in  the  final  i-esn!! 
ol  tin;  calculafaxl  height  is  rather  large  since  it  depends  on  mcxisiiring  two  shadow  hfurli!, 
vaJiies  from  the  image  ra.tli(;r  than  tnie. 

2.  I  his  second  method  allows  the  calcidation  of  the  sun  elevation  angle;  x  to  he  [lei  formod 
independently  Irom  the  image.  K  the  time,  date  and  location  of  the  ))hotf)giaph  are  known 
then  X  can  la;  caJcnlated,  using  a.strononnca.l  tables,  from  the  following  relation; 

sin.T  =  cosrt  X  cos/>  x  cosc±  sine,  x  .sin/>  (yi 

wherm  a  is  th(‘  latitude  of  l.he  photograph  location,  h  is  the  latitude  of  the  sun  lelaliw'  ir, 
i'ai.rth  when  the  |)hotograph  was  tak(,'n,  and  c  is  the  difference  in  longitude  helwr-en  Iho 
siin  and  the  |)hotograph  location. 

I  he  sign  in  the  ecpiation  is  a.  ”  -f”  ii  both  sun  latitude  and  the  phot.ograph  local  •  ion  a  re  on 
the  saiiK.*  side  of  the  Fapiator,  and  it  is  a  ”  ~  ”  il  they  are  on  opposite  sides  of  the  fapialor. 
.S(!e  figure  2.  'Fhis  is  because  the  sun  is  located  to  the  south  of  the  Equator  helwei.'n 
Sc'pl, ember  22  and  March  21,  and  it  is  locates]  to  the  noi  th  of  the  I'xpiatoi’  betwr'cn  March 
21  and  September  23. 

I  In.’se  two  methods  give  accurate  residts  only  il  the  foll(;wing  conditions  liold: 

1.  1  he  heights  of  the  objects  lor  which  shadow  heights  are  measuied  slionld  be;  vei  t.ical  with 
respect  the  image  plane. 

2.  1  he  entire  surface  ol  whei'e  the  shadows  are  cast  is  in  the  ]:)lanc  of  tin;  image. 

I'ignie  3  illustrates  the  problems  I, hat  arise  when  one  ol  these  two  conditions  is  not,  mol.. 

5  UNSOLVED  PROBLEMS 

In  ail}'  single  image  ol  a  rea.l  world  location,  shadows  represent  the  ma joi'  source  of  informal  ion 
about  the  height  ol  raised  structures  in  that  ima.ge.  Using  shadows  to  calculate  building  heights 
can  pioduce  a.ccnra.te  results.  Man}'’  scientists  have  manuaJly  calculat.ed  heights  of  object, s  in 
ac'i’ial  photographs  using  shadows  and  .some  have  actually  succeeded  in  automating  t  he  process, 
h'lost  work  which  has  been  done  in  the  area  .so  far  remains  highly  resti  ictive  which  makes  il  less 
nselnl  in  practical  a|)plications.  I)<;vising  and  imi)lementing  an  algorithm  that  extracl.s  shadow- 
areas  anil  idi.'iitihes  the  prop<;rties  of  raised  structures  of  a.rbit.rary  height  and  shape  in  an  aerial 
phol.ogi  a[)h  can  lx;  included  as  a  part  ol  a  coinpli'te  system  of  aerial  |)hotograph  intc'i  pretal  ion. 
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If  the  angle  of  the  sun  elevation  "x"  is  known  then  the  actual  height 
of  a  building  can  be  found  using  the  length  of  its  shadow  from  the 
equation: 


BH  =  SL  tan(x). 


Figure  1  -  A  structure  height  can  be  determined  using  shadow  length. 


The  sun  has  some  latitute  b  above 
the  equator  (between  March  21  and 
September  23)  and  point'  p  is  north 
of  the  equator. 

sin(x)  =  cos(a-b)  =  cos  (a) 


The  sun  has  some  latitute  b  belcv; 
the  equator  (between  September  23 
and  March  21)  and  point  p  is  scueh 
of  the  equator. 

cos(b)  +  sin(a)  sin(b) 


The  sun  has  0  latitute  (i.e.  the  sun  rays  are  perpendicular 
to  the  equator)  on  March  21  and  on  September  23. 

sin (x)  =  cos  (a) 


The  sun  has  some  latitute  b  below 
the  equator  (between  September  23 
and  March  21)  and  point  p  is  north 
of  the  equator. 

sin(x)  =  cos  (a+b)  =  cos 


The  sun  has  some  latitute  b  above 
the  equator  (between  March  21  and 
September  23)  and  point  p  is  sc'it 
of  the  equator. 

a)  cos(b)  -  sin(a)  sin  (b) 


Figure  2  -  Calculating  the  angle  of  the  sun's 
elevation  "x"  at  point  "p"  which  has  a  latitude 
angle  "a"  depends  on  the  time  of  year. 


Figure  3  -  If  the  shadow  is  not  cast  on  the  plane  of  the  image  or  the 
building  height  is  not  peipendicular  to  the  plane  of  the  image  then 
the  calculated  building  height  will  be  different  from  its  actual  height. 
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•  Department  of  Com[)nter  Science  and  Engineering 
University  of  Soutli  Florida,  Taiiijia.,  Florida  33G20 

I  iic  i)iirpo.se  ol  this  aiinolated  bibliography  is  l.o  define  the  body  of  the  litcs-ature  which  will 
lead  1,0  an  understanding  of  the  current  state  of  the  art  in  the  area  of  using  shadows  to  (jxtract 
ijiiilding  models  Irom  aerial  images.  After  an  initial  review  of  the  literature,  it  appears  that  the 
most  nselul  relerences  arc:  Irvin  and  McKeown,  Huertas  and  Nevatia,  Liow  and  Pavlidis,  and 
I'lia  and  Hanson.  It  is  clear  that  the  current  state  of  the  art  does  not  allow  a  reliable  totally 
automated  ’’image  in  -  building  model  out”  processing  sequence.  However,  it  does  appear  I  ha! 
a.  substantial  degree  ol  automation  is  possible.  In  the  lollowing  list,  tmu  will  find  an  ovei'vii'w 
ol  t.he  l)ool';s  and  papers  that  we  have  reviewc'd  .so  far: 


1.  1.  1’..  Avery.  Interpretation  o(  Aeria.l  IMiotographs,  Minnea|)ohs  MN:Burgess  Publishina 
Company,  1977. 

Chapter  ‘i  ol  this  te.xt  provides  detailed  explana,tion  of  the  method  of  using  shadows 
to  determine  the  height  ol  an  object  in  an  a.erial  image.  It  also  provides  the  er|uation 
controling  the  angle  of  the  sun’s  elevation  relative  to  Eartli  and  e.xplains  how  this  angle 
can  be  used  in  l.he  height  determination  process. 

2.  John  A.  Howai'd  Aerial  Photo- fjcologv,  American  Elsevier  Publishing  C^ompnn\'  Inc 
1970. 

Chai)ter  15  of  this  te.xt  contains  a  good  discussion  of  the  determination  of  ”aiq)arent 
height”  ol  an  object  in  an  aeria.l  image  Irom  both  shadow  and  stereo.  'Phe  discussion  is 
oiiented  more  towai  ds  manual  e.xtiaction  of  data  Irom  images  and  ineasurment  of  natural 
leatures  (tree  stands),  however,  it  prvides  the  basic  ideas  in  a  clear  fashion  that  thev  can 
be  a))plied  to  man-ma.de  structures,  d’his  cahpter  is  also  useful  in  that  it  provides  detailed 
explanations  of  possible  sources  of  error  in  applying  the  suggested  tcchni(|ucs. 

■?.  A.  Huertas  and  R.  Nevatia.  Detection  of  Buildings  in  Aerial  Images  Using  Shape  and 
Shadows,  I  he  Sth  International  Joint  Conference  on  Artificial  Intelligence,  ])p  JOOO-lOol 
1983. 

Ihis  paper  describes  an  edge  based  tecfmi(iue  which  exploits  dues  provided  b\’  shadows 
ol  buildings  in  aerial  images.  Increasingly  complex  features  are  slowly  constructed  by- 
using  consistently  interpreted  intensity  boundary  segments.  Imatuie  inter|)reta.f,ious  ai-e 
d<‘tei  mined  basi.’d  on  constraints  im|>os<;d  on  the  interpretations  ol  obser\-f,'d  iutensil  \’ 
boiimlary  Iragmeiil.s  and  groiqis  ol  Iragments  by  tin,"  imaging  process. 

■1.  A.  Huertas  and  R.  .Nevatia.  Detecting  Buihlings  in  Aeria.l  Images.  Compuf.er  X'ision. 
Cra,|)hic.s,  and  Image  Processing'll,  131-1.99  (1988). 

I  his  paiier  is  an  e.xpaiuled  version  ol  the  earlier  Huertas  and  Nivatia  paper  aiul  it  describe 


;i  l,<'cliiii(|uc  lor  cxi.ract.ioii  o(  buildings  in  aerial  images.  'I’liis  IccliiiiqiK'  uses  sliadows 
easl,  by  these  buildings  to  confirm  their  piassence  and  estimate  theii'  height.  'I'iie  basic 
assumi)tion  introduced  is  that  buildings  that  can  be  modeled  as  i)arallel|)ii)e(ls.  Shadows 
aia?  used  in  labeling  detected  corners  and  confirming  the  e.xistence  of  a  3-<limensionai 
structure  when  a  closed  2-])  boundary  is  found.  'I'he  jn-oitosed  method  consist.s  of  Com 
basic  steps: 

(1)  detection  of  lines  and  corners  using  some  standard  tcchnicpie. 

(2)  labeling  of  corners  as  object  or  shadow  corners. 

(3)  tracing  object  boundaries. 

(d)  verification  of  building  hypotheses. 

Results  are  shown  foi‘  a  pair  of  images  of  Los  Angeles  International  Airport. 

5.  Iv.  Bruce  Irvin  and  David  M.  McKeown,  .Ir.  Methods  loi‘  E.xploiting  the  Relationship 
B('twe(Mi  Buildings  and  J  heir  Shadows  in  Aerial  ImagfU'}'.  IEEE  'rraiisactions  on  Sx'slems. 
Man,  and  Cybernetics,  vol.  19  no.  G,  pp  15G4-1575,  (J9S9). 

i  his  is  a  recent  paper  Irom  one  of  the  leading  research  gioujrs  in  the  area.  In  this 
paper  the  relationship  between  rnan-made  structures  and  their  shadows  is  used  in  devising 
computational  techmdpies  lor  e.xtracting  buildings  from  aerial  images.  1'hree  progiains  are 
described,  each  of  which  exjtloits  the  presence  of  shadows  in  the  image  in  differenl  wa\'s. 
’’Shade”  is  the  nameol  thei)rograrn  which  does  shadow  detection  .  Shade  identifies  l  egions 
ol  the  image  which  are  likely  to  repre.sent  sliadows  of  buildings.  ’’Crouper”  is  another 
prograiTi  that  uses  hypothesized  shadow  regions  to  group  building  regions  which  may 
r('present  fragmented  poi'tions  of  one  building.  ’’Shave”  is  a  program  tha  t  uses  the  presence 
ol  shadow  legions  in  the  image  to  verify  that  buildings  actuall}'  exist  in  hypoi  hesized 
building  regions.  Example  results  are  given  for  two  images  from  the  Washington  D.C.  ai  ea. 
3  his  work  is  important  in  that  shadow  analysis  is  used  as  one  of  mull.iplc  complementai  v 
techniques. 

(>.  John  R.  Kender  and  Earl  M.  Smith.  Shajic  From  darkness:  Deriving  Surface  Information 
from  Dynamic  Shadows,  National  Conference  on  Artificial  Intelligence,  GG-1-6G7,  19SG. 

1  his  pajier  presents  a  method  for  extracting  surface  shape  information  based  of  object  self- 
shadowing  under  moving  light  sources.  One-dimensional  dynamic  shadows  are  analvized 
in  the  continuous  case,  and  their  behavior  is  categoi'ized  into  three  exhaustive  shadow 
cla.s.ses. 

7.  Yuh-Tay  Liow  and  Theo  Pavlidis.  U.se  of  Shadows  for  Extracting  Buildings  in  .Aerial 
Images,  Computer  Vision,  Graphics,  and  Image  Processing  49,  242-277  (1990) 
i  his  paper  describes  two  approaches  to  the  use  of  shadows  in  detecting  buildings  in  aei  ial 
images.  I  he  fii'st  approach  begins  with  a  split-and-merge  region  growing  segmentation 
stage.  Somewhat  oversimpliPied,  the  first  approach  does  erlge  detection  and  then  region 
growing,  whereas  the  second  does  region  growing  first  and  then  edge  detection.  'J'he 
gc'iK'ral  |diilosoi)hy  ol  the  work  is  to  have  multiple  segmentation  stages  whose  results  can 
be  combined  to  achieve  more  robust  scene  analysis.  The  emphasis  is  more  on  I, he  low- 
level  image  segmentation  techni(|ues  than  on  the  recovery  of  building  height.  Results  are 
illustrated  using  tlie  same  pair  of  images  used  by  Huertas  and  Nevatia,  as  well  as  threx' 


oilier  iniaL’.es.  It,  is  claimed  t.lial,  met  hods  <i<'scri  Ix'd  here  arc'  applieaMe  lo  liiiildinL’s 
wil.h  l.oxUircd  rools,  and  l.ha.l,  hnildiii",  shape's  are  iiol.  resl,ric't,(.'d  lo  lx.'ing  r<'(i,an”iilar. 

l)a\'id  M.  iVIcKcowii,  Jr.  'I  he  Ivoleol  Arlifieial  liilelligenei!  in  the  lulegialioii  of  l\ei!iotel\- 
Seii.sed  Dala.  with  Ccograpliic  liilormatioii  .Systems.  'rraiisactioiis  on  Cleoscieme 

and  Ivemole  Se.Mising,  vol.  Clv2r)  No.  J,  J.JOdMS,  (!i)S7) 

I  his  pa.|)'ei'  discusses  the  possible  roh'  ol  A1  in  tin.'  elesign  ol  geogiaphic  infoinialion  s\s- 
tems.  It  begins  with  a  short  discussion  of  issues  involved  in  using  A1  teclmicpies  to  |)i-oeliu;c 
more  powerful)  geogra|)!dc  information  .systems.  'Flie  remainder  of  the  |)ai)er  tlien  illus¬ 
trates  some  of  these  issues  in  the  coute.xt  of  the  MAP.S  system  and  apjdications  based 
on  MAP.S.  MAP.S  is  a  ’’spaeial  database”  s^'stem  which  includes  high  resolution  aerial 
imagery,  a  digital  terrain  rnaj)  data  and  landmark  data. 

t).  David  M.  McKeowUjJr.  and  Jerry  L.  Denlinger.  Cooperative  Metliods  foi-  Road  Tiacking 
in  .Aerial  Imager}',  IDEE  Comi>utcr  Vision  and  Pattern  Recognition  Conference,  bfl2-()72. 
.bine  1983. 

'I'his  paper  provides  a  description  of  a  S3'stem  for  load  tracking  called  .ARE  (.A  Road 
I'ollower)  in  ax.'iia.l  imagery.  This  system  is  a  rnnlti-level  architecture  for  image  anal}'sis 
lhat  allows  foi'  coo|)eration  among  low-level  j)roces.scs  and  aggregation  of  information  b\- 
high-level  analysis  components,  two  low-level  methods  are  imjrlemenlcd;  road  surface 
t(.*.\'ture  correlation,  and  road  edge  following.  A  liigh-level  module  is  then  used  to  general e 
the  final  symbolic  description  of  the  road  in  terms  of  its  vai'ious  attributes. 

10.  .Shaler,  A.  (1985)  Shadows  and  .Silhouettes  in  Computer  Vision.  Elnwer,  Boston. 

This  book  provides  an  analysis  rd'  shadow  geometry  starting  with  the  simplest  kind  of 
slnidow  problem  which  occurs  when  a  single  polygon  casts  its  shadow  on  a  flat  surface 
due  to  a  fixed  source  of  light.  The  book  then  |)rovidf;.s  discussions  involving  more  com¬ 
plicated  objects  such  as  .curved  objects  and  solids  of  levolution  under  various  sources  of 
illumination.  For  each  class  o!  objects  the  book  i)rovides  detailed  exi)lanations  of  the 
foi'innlas  constraining  the  geometry  of  the  shadows. 

I  I.  .Singh,  R,.K.  and  Ramakrislina,  R.S.  Shadows  and  J'exture  in  Cornputei'  Vision.  Pattern 
Recognition  Letters  11,  133-lJl,  1990. 

'I  his  paper  explores  the  idea  of  using  shadows  in  construct.ing  3-dimensiona,l  scenes  fiom 
their  2-dimen.sional  images.  It  al.so  introduces  a  method  for  using  texture  as  an  achlitional 
source  ol  information  in  cases  where  information  extracted  from  shadows  in  not  a.decniat(' 
for  constructing  the  3-dimensionaI  scene.  The  .solution  to  the  basic  shadow  inoblem 
described  by  .Sha.fei'  in  his  book  (where  a  single  polygon  and  a  single  source  of  light  are 
considercal)  is  explained  and  used  in  obtaining  the  sha.dow  geometry  for  jrolyhedra.  Using 
the  iulorma.tion  |)i'ovided  by  shadows  and  texture  combined  as  .a  mctliod  for  constructing 
3-dimensional  scenes  lor  objects  with  curved  surfaces  is  also  given.  No  results  of  real 
image  examples  are  given  in  this  paper. 

12.  William  H.  Ihompson,  .Miclnu'l  J’  Cheeky  and  William  k'  KaemmeKU'.  Shadow  Stereo 
-  Locating  Object  Boundaries  Using  Sbadows,  Sixth  National  Conlerencx;  on  .Artificial 
Intelligence,  7Gl-7(i(i,  Jnl}’  1987. 


I  Ills  paper  (le.s(  ril)es  a  iik'I.IuxI  lor  relia.lrly  (le(e(-|.in,!.*;  shallow  edees  eoi  respondiiw  lo  oli  jecl 
edaes.  'I'liis  ntel.liod  is  ahle  to  distiiij^iiisli  hetweeii  d(‘la-cted  ed^^i-s  dm.'  lo  shadow  and  I  hose 
due  lo  surface  markings.  A  simple  stereo  teclmi<|ue  which  does  not  rer|uir('  a  .sohiliou  lo 
th(.'  gmieral  correspondmice  i)rol)lem  is  described,  lii  this  teclmique,  a  rnultidighl,  souice 
iiu.'tliod  or  a  multi-camera,  method  can  be  impleiiK.Mitrxl. 

Id.  I).  Waltz.  UiidcM-staiidiiig  lane  Drawings  of  Scenes  vv'ith  Shatlows,  in  'Phe  P.s\’cholog\’  of 
Comi)uter  Vision,  IMI.  Winston,  ed..  New  York:  McClraw-llill,  197b. 

1  his  paper  desciibes  some  of  the  earkn'r  work  winch  deals  with  thr;  relationship  between 
idealized  objects  and  their  shadows.  Elaborate  descri])tion  for  junction  and  line  labelinu 
teclmicpies  are  given.  Also  several  programs  that  give  3-dimensional  iid'ormation  IVom 
2-dimesional  images  of  objects  with  planner  surfaces  are  described  in  details.  .Although 
this  pajjer  desciibes  the  relationship  between  shadow  geometiy  and  the  objects  causing 
these  shadows  in  great  details,  this  work  applii's  mostly'  to  idealized  objr'cts  rather  than 
actual  images. 

11.  Pascal  knaand  .Andri'w  .1.  Hanson.  Using  Generic  Geometiic  Models  for  Intelligent  .Sliajie 
E.xtraction,  DAK  PA  Image  Understanding  Workshop  19S7,  227-233. 

I  his  ]>aper  provides  a  model-based  implernention  lor  idi'iitifying  objects  in  an  ae.'iial  pho¬ 
tograph.  1  he  models  used  to  identify  the  objects  are  not  simply  regid  templates  that  can 
b('  matched  to  objects  in  the  image,  but  rather,  they  use  deliniations  that  desci  ibi'  gener  ic 
classes  of  objects.  'J'hey  use  edges  in  the  image  lo  extract  the  various  areas  and  then  li.-st 
which  of  tlie.se  areas  correspond  to  which  of  the  generic  models  which  they  have  di'signed. 

II  any  ol  the  areas  extracted  does  not  correspond  to  any  of  the  models  t  hen  the  syslem  is 
al.)le  to  predict  the  sha])e  ol  the  missing  parts  and  complete  the  boundaries  of  such  areas. 

15.  M.  Nagao,  'F.  Matsuyama,  and  1.  Ikeda  Region  Extraction  and  Shape  Analysis  In  .Ac.r  ial 
Photographs,  Computer  Graphics  and  linage  Processing,  vol  10,  no.  3,  195-''’'^3  .Inlv 
1979. 

'I'liis  pajier  describes  a  complete  system  for  interpreting  aeiial  photogra])hs.  'J'he  system 
has  several  levels  of  processing.  The  liighest  level  performs  a  basic  segmentation  of  the 
whole  image  and  produces  boundaries  for  Vcirious  areas  within  the  image.  Each  of  these 
boundaries  is  assumed  to  represent  an  element  in  the  real  world  location.  The  next  hwel 
in  the  [uocess  exarnins  each  of  the  areas  found  to  determine  its  various  properties,  such  as 
shape,  size,  brighness,  location,  etc.  Based  on  this  analysis  of  each  area,  the  system  may  ■ 
continue  in  one  ol  several  directions  depending  on  the  particular  olpjective  of  running  the 
algorithm  and  on  the  basic  area,  t^'pes  found  in  the  image. 
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Monthly  Report  September  1990 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

1.  Work  continues  on  the  CAD-style  package  to  be  built  by  Maha  Sallam  and 
Kevin  Boyer.  This  package  will  allow  the  "manual"  shadow  analysis  of  an 
image.  It  will  output  polyhedral  descriptions  of  objects  (buildings)  in  the 
image.  This  data  will  then  be  converted  to  run  on  the  ESIG  500  located  at 
ITS/VSL.  This  will  allow  an  interactive  flyby  of  the  objects  detected  by  the 
shadow  analysis.  Maha  and  Boyer  will  deliver  the  shadow  analysis 
programs  to  Brian  Blau  on  October  15.  Work  will  then  being  translating 
their  data  to  run  on  the  ESIG  500. 

2.  Mubarik  Shah  and  Derrik  Tolley  continue  to  implement  stereo 
algorithms  which  extract  the  depth  of  objects  which  are  in  an  image.  One 
algorithm  is  based  on  edges  in  the  image,  and  gives  a  sparse  depth  map. 

The  other  algorithm  is  based  on  correlation  and  will  produce  a  dense  depth 
map.  Planned  delivery  of  these  programs  to  Brian  Blau  is  the  end  of  October. 

3.  Chuck  Campbell  is  working  on  another  CAD-style  package  in  conjunction 
with  Shah's  and  Tolley’s  stereo  programs.  This  CAI>style  program  will  let 
the  user  "manually"  select  features  of  an  object  and  place  them  in  a 
database.  This  database  can  then  be  used  in  an  interactive  flyby  of  the 
objects  that  were  detected  by  the  stereo  algorithms. 

4.  Chuck  Campbell  is  continuing  his  literature  search  on  cartographic 
imagery. 

5.  A  visit  and  presentation  was  made  by  Image  Data  Corporation  on  August 
31.  Their  beta  version  software  demonstrated  building  extraction 
algorithms  using  shadows,  similar  to  those  being  investigated  by  Maha  and 
Boyer.  Their  product  has  only  had  limited  release  and  was  only  available  on 
a  few  workstations.  Possible  help  to  this  project:  not  much  in  the  near 
future,  but  will  keep  in  contact  with  them  as  their  product  line  expands. 

6.  Attached  is  a  detailed  timeline  for  the  remaining  of  the  calendar  year. 
Problems 


None  at  the  present  time. 


Timeline  for  the  Geospecific  Database  Project  (Sept  1990) 


September  October  November  December 

ZJ _ 28  5  12  19  26  2  9  16  23  30  7  14 

#1  #2  #3  #4  #5  #6  #7 

(all  dates  are  Fridays) 


#1  Work  to  be  done:  Final  plan  due  for  CAD  package.  Begin  working  on  CAD  package. 
By  who:  Blau  and  Campbell. 

By  when:  Friday,  Sept  21.  (may  change  if  Shah  and  Boyer  need  more  time  on  #2) 


#2  Work  to  be  done:  Based  on  the  work  done  since  8-29,  commit  to  dates  set  in  this  timeline. 
By  who:  Blau,  Boyer,  Shah 
By  when:  Friday,  Sept  28. 


#3  Work  to  be  done:  Receive  work  done  by  Boyer  and  Shah.  Work  out  any  bugs  with  their 
programs.  Get  XI 1  working  on  the  Sparc  Station. 

By  who:  Blau,  Boyer,  Shah,  Nelson. 

By  when:  Friday,  Oct  19. 


#4  Work  to  be  done:  Complete  work  of  CAD  package.  The  complete  path  from  images 
to  image  generator  should  be  working  by  this  time.  Work  out  any  bugs  in  everyone’s  code. 
Make  a  package  of  software  to  distribute  which  includes  all  of  our  combined  work.  Visit 
from  Boyer  and  Shah  to  see  everything  work. 

By  who:  Blau  and  Campbell. 

By  when:  Friday,  Nov  16.  (Visit  could  be  on  Nov  23  if  not  ready) 


#5  Work  to  be  done:  Have  ready  a  document  which  will  include  all  of  the  bibs,  papers 
and  related  work  done  so  far.  All  documentation  will  be  done  at  this  time.  -  Program  docs, 
-  Related  papers,  -  Cartographic  literature  search. 

By  who:  Blau  and  Campbell. 

By  when:  Friday,  Nov  23. 


#6  Work  to  be  done:  Make  the  final  plans  for  the  demonstration  to  the  sponsors.  Give 
a  dry  run  of  the  demo  to  M.  Moshell. 

By  who:  Blau. 

By  when:  Wednesday,  November  28. 


#7  Work  to  be  done:  Demonstration  for  the  sponsor.  All  attend. 

By  who:  Blau,  Campbell,  Moshell.  (Shah  and  Boyer  out  of  the  country) 
By  when:  Mon,  Tue  or  Wed  December  3-5. 


Prepared  by  Brian  Blau 
9/17/90 


Project  Monthly  Report  -  September  1990 
Multiple  IG  Databases  (MIDB)  Project 
Project  Lead:  Curtis  Lisle 


Accomplishments: 

1.  Installation  of  S-1000:  The  S-1000  version  received  from 
BBN  has  been  installed  at  1ST  and  is  partially  functional.  Additional 
texture  libraries  and  bug  fixes  are  still  needed.  We  have  received 
BBN’s  consent  to  get  the  texture  library  from  ETL.  To  further 
support  IST’s  efforts  on  S-1000,  a  time  and  materials  support 
contract  with  BBN  is  planned. 

2.  MultiGen  to  ESIG  Interface:  A  test  database  containing  the 
Research  Pavilion  and  NTSC  building  at  Research  Park  was  modeled 
in  MultiGen.  converted  by  Chen  Jinxiong’s  filter,  and  displayed  on  the 
ESIG.  The  filter  does  not  handle  generating  all  the  priority 
information  necessary  for  the  ESIG,  but  produced  visually-pleasing 
results  for  an  early  test  case. 

3.  VISTA  to  ESIG  Texture  Formatter:  Work  has  begun  on  a 
conversion  program  to  allow  new  ESIG  texture  maps  to  be  generated 
by  the  VISTA/TIPS  paint  package  (which  runs  on  IBM  PCs).  This  will 
be  a  cheaper  and  faster  solution  than  buying  additional  texture  tools 
from  Evans  and  Sutherland. 

4.  DTED  and  DEAD  Data:  DTED  and  DEAD  data  have  been  read  into 
the  MultiGen  system  using  the  nine  track  tape  drive.  The  effort  to 
import  DTED  into  the  S-1000  system  has  begun. 

5.  Database  System  Comparison  Report:  Jacki  Morie  completed 
a  comparison  report  which  supplies  an  overview  of  the  BBN  S-1000 
system,  the  E&S  ESID  system,  and  Software  Systems’  MultiGen 
system. 

6.  Ft.  Rucker  Database:  IST/VSL  is  considering  the  possibility  of 
developing  a  Ft.  Rucker  database  using  S-1000  for  ARI.  Several  ARI 
personnel  from  Ft.  Rucker  visited  1ST  and  described  their  current 
projects  and  the  needs  for  their  future  work. 


Project  Monthly  Report  -  September  1990 
Multiple  IG  Databases  (MIDB)  Project 
Project  Lead:  Curtis  Lisle 


Current  Problems: 

The  S-1000  system  must  be  completely  operational  before  work  can 
begin  on  the  MultiGen  to  S-1000  interface.  The  S-1000  system  is 
not  intuitive  and,  at  this  point,  we  have  poor  documentation  and  a 
poor  support  level  from  BBN.  Installing  and  using  this  tool  will  be 
harder  than  originally  expected. 


MIDB  Project  Timeline 
Curtis  Lisle 
Sept.  24,  1990 

The  goal  of  the  MIDB  project  is  to  construct  a  database  development 
environment  which  simultaneously  supports  multiple  Image  Generator  (IG) 
architectures.  The  databases  created  will  only  need  to  be  developed  once 
cmd  will  be  processed  by  reformatting  tools  to  allow  them  to  run  on  different 
IGs. 

Since  a  single  database  source  will  be  processed  by  different  formatters,  the 
subject  of  database  correlation  will  be  addressed.  In  this  context, 
correlation  refers  to  the  process  which  guarantees  that  the  IG  databases 
(produced  by  the  MIDB  formatters)  are  consistent  and  accurate  with  respect 
to  each  other  (all  the  features  are  in  the  same  place,  etc.). 


Timeline: 


September 
2T  28 

October 

5  12 

19 

26 

November 

2  9  16 

23  30 

December 
7  T4 

#4 

#1 

#2 

#3 

#5, #7 

#6  (?) 

(all  dates  are  Fridays) 


Description  of  Timeline  Tasks: 

Task  #1: 

Train  on  S-1000:  Curt  Lisle  and  Jacki  Morie  will  train  in  the  use  of  the  S- 
1000  system.  By  completion  of  this  task.  Lisle  and  Morie  will  be  proficient  in 
the  S-1000  interface  and  able  to  construct  simple  visual  databases. 
Documentation  is  still  lacking  for  some  of  the  S-1000  modeling  tools 
(otherwise,  this  would  be  a  two  week  process). 

Deliverables:  Two  educated  and  happy  S-1000  modelers 
MIDB  personnel:  Brown,  Lisle,  Morie 

Task  #2: 

Port  S-1000  database  to  SIMNET:  Several  of  the  simple  databases 
constructed  during  task  #1  will  be  compiled,  formatted,  and  run  on  the 
SIMNET  tanks  at  1ST. 

Deliverables:  Demo  of  database  on  SIMNET 
MIDB  personnel:  Brown  with  Morie  (observing) 


Task  #3; 

Define  S-1000  formats:  Once  simple  databases  are  constructed  with  S- 
1000,  these  (along  with  the  S-1000  documentation)  will  serve  as  models  to 
study  the  S-1000  datafile  formats.  At  the  completion  of  this  task,  a 
specification  (spec)  will  be  written  describing  how  to  format,  arrange,  and 
store  a  database  in  S-1000  format. 

Deliverables:  S-1000  datafile  spec 
MIDB  personnel:  Morie,  Lisle 


Task  #4: 

VISTA  to  ESIG  Jexture  formatter:  Develop  a  prototype  interface  to  generate 
ESIG  texture  files  from  VISTA  format  pictures.  This  allows  the  creation  of 
additional  ESIG  texture  maps  and  defines  the  format  in  which  ESIG  texture 
will  be  created  by  later  tools.  A  spec  document  will  be  produced  which 
describes  the  ESIG  file  format  and  the  formatter  program. 

Deliverables:  Formatter  program,  ESIG  texture  spec 
MIDB  personnel:  Buckley,  Klasky 

Task  #5: 

Multigen  to  ESIG  interface:  Develop  a  formatter  which  reads  Multigen- 
format  datafiles  and  produces  ESIG-format  datafiles.  A  spec  document  will 
describe  the  interface  program.  The  formatter  program  will  not  support  all 
the  explicit  polygon  priority-ordering  necessary  for  the  ESIG. 

Deliverables:  Formatter  program,  formatter  design  spec 
MIDB  personnel:  Jinxiong,  Klasky  (help  with  spec) 

Task  #6: 

Design  Multigen  to  S-1000  interface:  Since  the  interface  output  format  is 
defined  by  the  spec  from  task  #3,  design  work  can  begin  on  the  interface. 

The  interface  will  read  Multigen-format  datafiles  and  produce  S-1 000-format 
datafiles.  Depending  on  the  interface  complexity,  this  step  may  also  include 
prototype  development.  The  completion  date  of  this  phase  is  only  tentative, 
it  will  be  firmed  up  when  more  detail  is  known  about  the  S-1000  database 
formats. 

Deliverables:  Design  document,  interface  prototypes  (possible) 

MIDB  personnel:  Lisle,  Morie,  Jinxiong 

Task  #7: 

VISTA  to  S-1000  Texture  formatten  Investigate  the  feasability  of 
converting  VISTA  files  into  S-1000  texture  files.  If  possible,  a  prototype 
formatter  will  be  written  and  demonstrated. 

Deliverables:  if  feasable,  a  formatter  program  and  documentation 
MIDB  personnel:  Buckley 


Future  MIDB  Directions: 


The  ESIG  formatter  described  in  Task  #5  does  not  sufficiently  order  the 
database  polygons  with  respect  to  each  other  so  the  ESIG  can  correctly 
display  them  in  all  cases.  An  ordering  algorithm,  similar  to  BSP  trees,  must 
be  developed  to  complete  the  MultiGen  to  ESIG  path.  This  will  be  addressed 
after  the  completion  of  Task  #5. 

Once  the  above  tasks  are  completed,  we  be  able  to  create  a  database  once 
using  MultiGen,  format  it  for  two  different  IGs,  and  begin  work  on  the 
database  correlation  issue.  The  MIDB  project  will; 

1.  Find  what  correlation  work  has  already  been  done  through  a 
literature  search  and  discussions  with  IG  database  vendors. 

2.  Develop  metrics  to  measure  the  correlation  between  different 
databases  and  investigate  the  feasablity  of  automatic  correlation 
tools. 


PREPARED  FOR: 


PM  TRADE 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (AOOl) 
BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report, 
contains  both  task  by  current  and  cumulative  cost.  The  Progress  Reports  are  by  separate  task. 


TASK  1 ;  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases  for 

Multiple  Image  Generators 


Cost  and  Progress  Reports 
28  November  1990 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 
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TOTAL  LABOR  HOURS  5186.00  2595.00  2591.00  |  1063.75  388.00  675.75 


Project  Monthly  Report  -  November  1990 
Multiple  IG  Databases  (MIDB)  Project 
Project  Lead:  Curtis  Lisle 


Accomplishments: 

1.  S-1000:  Jacki  Morie  and  Curtis  Lisle  are  continuing  to  train  on 
the  S-1000  system.  Arrangements  have  been  made  for  Morie  and 
Lisle  to  train  at  ETL  in  December  by  involving  them  in  ETL’s  S-1000 
activities.  We  received  information  from  BBN  on  how  to  build 
articulated  models  in  S-1000  (see  the  PRC  effort  description 
below). 

2.  MultiGen  to  ESIG  Interface:  Development  work  on  the 
interface  is  continuing.  In  particular,  color  attributes  for  database 
polygons  are  now  transferred  to  the  ESIG  correctly.  The  interface 
must  generate  additional  priority  information  since  the  ESIG  needs  a 
priority-resolved  database.  The  demonstrations  1ST  has  produced  so 
far  have  not  included  correct  inter-object  priority.  Software 
Systems  agreed  to  help  1ST  solve  the  priority  resolution  issue  for 
MultiGen  databases. 

3.  Project  2851:  Discussions  were  held  with  Software  Systems 
about  the  progress  of  P2851.  IST/VSL  and  Software  Systems  agreed 
to  cooperate  on  the  development  of  a  2851  to  MultiGen  flight 
formatting  process.  1ST  sent  a  request  to  P2851  restating  our 
interest  in  receiving  a  copy  of  the  next  GTDB  distribution. 

4.  PRC  NLOS  Icon:  Negotiations  between  PRC  and  1ST  are 
continuing  over  the  schedule  and  what  deliverables  1ST  will  provide 
to  PRC.  The  S-1000  training  which  Morie  and  Lisle  will  receive  at 
ETL  in  December  should  enable  1ST  to  develop  the  required  compiled 
icon.  The  icon  needed  by  PRC  is  a  HMMWV  vehicle  with  an  articulated 
rocket  launcher. 

5.  ITSC  Demo:  Several  members  of  the  MIDB  team  were  involved  in 
the  ITSC  demonstration  given  by  1ST  at  the  UCF/Research  Park 
conference  booth.  We  demonstrated  moving  models  (tanks) 
interacting  and  dynamically  cratering  a  piece  of  SIMNET  terrain 
extracted  from  one  of  IST’s  SIMNET  systems. 

6.  Database  Correlation:  1ST  is  coordinating  with  Dr.  Kate 
Kinsley  on  a  literature  search  of  DOD  simulation  papers.  Several 


Project  Monthly  Report  -  November  1990 
Multiple  IG  Databases  (MIDB)  Project 
Project  Lead:  Curtis  Lisle 


more  articles  were  reviewed  and  summarized  toward  a  goal  of 
producing  a  paper  summarizing  the  best  DOD-sponsored  work  in  the 
area  of  database  representation  and  correlation. 

Current  Problems: 

We  submitted  a  request  to  BBN  on  11 -November  to  establish  a 
consulting  contract  with  1ST.  This  contract  would  enable  us  to  get 
technical  support  from  BBN  on  S-1000  and  the  SIMNET  CIG  as 
problems  are  encountered  during  the  MIDB  project  at  1ST.  We  have 
received  no  answer  from  BBN  so  far.  This  continues  to  slow  our 
progress. 


Monthly  Report  November  1990 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

Xwindows  is  now  up  and  running  on  two  Sparc  workstations  and  one 
Silicon  Graphics  workstation.  Xwindows  was  necessary  for  the 
operation  of  the  height  from  shadow  program  from  Dr.  Bowyer  and 
Maha  Sallam.  With  Xwindows,  it  is  possible  to  run  a  program  on  one 
machine  while  working  on  another,  which  allows  greater  flexibility  in 
the  lab. 

Bowyer  and  Sallam  will  be  at  1ST  on  Nov.  28  to  discuss  the  status  of 
the  project.  While  they  are  here,  we  hope  to  resolve  the  problem  we 
are  having  with  running  their  program,  described  below  in  the 
problems  section. 

Chuck  Campbell  has  modified  Bowyer  and  Sallam's  algorithm  to 
produce  output  compatible  with  Lisle’s  ANIM  program  for  display  on 
the  Silicon  Graphics  workstation.  Currently,  all  buildings  have  a  fixed 
height,  due  to  the  problems  we  are  experiencing  with  the  program, 
but  only  a  slight  modification  should  be  required  to  use  the 
calculated  building  height  once  the  problem  is  resolved. 

During  I/ITSC,  we  discovered  that  GE  is  doing  work  in  the  same  area 
we  are.  They  demonstrated  construction  of  a  3-D  database  from  a 
pair  of  images,  although  they  claimed  they  can  use  only  one  image. 
They  also  demonstrated  extraction  of  building  features.  In  addition 
to  this,  they  are  also  doing  some  work  calculating  building  height 
from  shadows,  although  they  had  no  demonstrations  of  this.  Their 
work  was  very  impressive,  and  we  believe  it  would  be  a  good  idea  to 
talk  with  them  further. 

Problems 

We  have  not  been  able  to  produce  correct  output  from  Bowyer  and 
Sallam's  program.  We  get  accurate  values  for  the  building  and 
shadow  traces,  but  the  calculation  of  the  shadow  length  and  building 
height  produces  obviously  incorrect  answers.  After  correspondence 
with  Bowyer  and  Sallam,  we  believe  the  problem  to  lie  in  the 
operating  environment  and  not  with  the  user  or  the  program. 


A  requirement  specification  for  the  current  UPAS  project  which 
describes  the  concepts  of  the  AAR  aids  and  the  requirements 
for  UPAS  task  2  has  been  received  by  1ST  from  Dr.  Meliza,  ARI. 
With  that  specification,  1ST  has  a  better  understanding  of  the 
user's  requirement  and  will  be  better  able  to  accomplish  the 
project  goal  that  meets  the  user's  needs. 


PLANS 

•  Finish  up  the  review  and  update  of  the  UPAS  in-line 
documentation  performed  by  Perceptronics 

•  Have  Perceptronics  fix  the  known  UPAS  software  bugs  and 
update  the  UPAS  user's  guide  as  per  Dr.  Meliza 's  review 
comments 

•  Finalize  the  UPAS  task  1  acceptance  test  plan  and  get 
ready  for  the  acceptance  test 

•  Run  upgraded  UPAS  software  on  SIMNET  6.6  exercise  data  to 
see  if  they  are  compatible  as  per  ARI ' s  request 

•  Continue  to  work  on  the  other  UPAS  tasks 
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_ UNIVERSITY  OF  CENTRAL  FLORIDA _ 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 

1 2424  RESEARCH  PARKWAY,  SUITE  300,  ORLANDO,  FLORIDA  32826  (407)  658-5000 

November  28,  1990 

PM'mADE 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Raymond  F.  Green  AMCPM-TND-ET 

Subject:  BAA  89-01  Monthly  Progress,  Status  and  Management  Report 

Reference:  Contract  N61339-90-C-0042  (CDRL  AOOl) 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress,  Status 
and  Management  Reports  and  Cost  Reports  for  Task  1  and  2  for  the  November  1990  time  period 
are  forwarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  call  me  at  658-5014  or  658-5000. 

Sincerely, 

c -Ernie  Smart 
Program  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


PM  TRADE 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (AOOl) 
BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report, 
contains  both  task  by  cuirent  and  cumulative  cost.  The  Progress  Reports  are  by  separate  task. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases  for 

Multiple  Image  Generators 


Cost  and  Progress  Reports 
December  1990 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 
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Monthly  Report  December  1990 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

1.  On  November  28,  Kevin  Boyer  and  Maha  Sallam  made  a  visit  to  IST/VSL. 

During  there  visit,  Sallam  was  able  to  fix  the  problems  that  were  in  the 
height  from  shadow  algorithms.  Now  that  these  problems  were  fixed,  its 
output  is  now  correct.  This  output  is  used  as  input  to  the  display  program 
running  on  the  Silicon  Graphics  workstation.  During  this  visit,  there  was 
some  discussion  of  enhancements  to  their  programs.  This  would  probably 
be  delivered  during  January. 

2.  Curt  Lisle  from  ISTA^SL  is  making  contact  at  General  Electric  Simulator 
Division  in  Daytona  Beach.  We  would  like  to  see  their  image 
processing/database  generation  software  that  was  demonstrated  at  the 
I/ITSC  conference.  This  meeting  will  be  scheduled  for  sometime  in  January 
and  will  be  attended  by  Blau,  Campbell,  Moshell,  Shah,  Boyer  and  Sallam. 

3.  All  of  the  programs  that  were  scheduled  for  completion  are  now  finished. 

There  are  four  main  programs  which  were  developed  : 

#1  Shah  Scene  depth  from  disparity  map 

#2  Campbell  CAD  program  to  interactively  build  database  from  #rs  output 
#3  Boyer  &  Sallam  Building  height  from  shadows 
#4  Campbell  Interactive  display  of  building  height 

Full  documentation  for  these  programs  is  currently  being  written.  This 
documentation  should  be  completed  by  the  end  of  January.  Also,  Campbell 
will  be  preparing  a  distribution  tape  of  the  programs  developed. 

Problems 

All  of  the  programs  developed  run  either  on  a  Sun  or  Silicon  Graphics 
workstations.  The  goal  is  to  have  all  programs  running  on  the  Silicon 
Graphics.  To  do  this,  more  Xwindows  include  files  and  libraries  need  to  be 
acquired.  This  should  be  done  by  January  and  all  programs  should  be 
working  on  that  platform  by  then. 


Project  Monthly  Report  -  December  1990 
Multiple  IG  Databases  (MIDB)  Project 
Project  Lead:  Curtis  Lisle 


Accomplishments: 

1.  S-1000:  Curtis  Lisle  and  Jacki  Morie  spent  one  and  two  weeks, 
respectively,  at  ETL  in  Ft.  Belvoir,  VA.  They  received  training  on 
BBN’s  SI  000  database  tools  by  working  on  ETL’s  database 
development  project.  1ST  is  now  familiar  enough  with  SI  000  to 
develop  and  view  new  databases  on  IST’s  two  SIMNET  CIGs. 

2.  SIMNET  Real-Time  Software:  As  1ST  develops  terrain 
databases  and  moving  models  for  the  SIMNET  CIGs,  It  will  become 
more  necessary  to  configure  and  use  BBN’s  real-time  software  (RTS) 
protocol  in  order  to  accomplish  our  goals.  We  have  received  little 
support  from  BBN  regarding  their  RTS  environment.  This  has  not 
impacted  our  progress  yet,  but  it  may  cause  delays  in  the  future. 

3.  ITD  data:  1ST  has  just  begun  an  effort  to  develop  ITD  data 
importing  tools.  At  this  time,  our  goal  is  to  import  ITD  data  into  the 
Flight  format  suitable  for  Software  System’s  MultiGen.  This  will 
enable  ITD  data  to  be  viewed  on  both  E&S  and  BBN  CIGs  when  IST’s 
formatting  programs  are  finished. 

4.  Project  2851:  Jacki  Morie  contacted  Tony  DelSasso  of  P2851 
and  found  they  are  planning  a  database  distribution  in  Summer  1991. 
He  said  that  an  early  release  might  be  possible  to  1ST.  We  are 
continuing  to  follow  the  progress  of  P2851. 

5.  PRC  NLOS  Icon:  1ST  now  has  the  technical  expertise  to  develop 
the  icon  needed  by  PRC.  This  will  serve  as  a  good  first  test  case  for 
a  multiple  LOD,  articulated  model  constructed  here  at  1ST.  Work  on 
the  icon  is  expected  to  be  completed  by  the  end  of  January  1991. 

6.  Database  Correlation:  The  literature  search  with  Dr.  Kinsley 
is  continuing.  Ron  Klasky  and  Dr.  Bruce  MacDonald  have  written  a 
proposal  addressing  future  work  directions  for  1ST  in  this  area. 

7.  ESIG  Host  Development:  Robert  Mangum  is  finishing  up  work  on 
the  ESIG-PC  network  link.  This  link  allows  remote  control  of  the 
ESIG  from  any  PC  with  an  ethernet  contoller.  For  speed 
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considerations  the  code  is  written  in  Assembly.  This  does  not  allow 
for  the  portability  of  the  software  and  so  it  will  be  re-written  in  C. 

8.  Polygon  Relaxation:  A  polygon  relaxation  software  system  is 
being  developed.  This  will  combine  co-planar  polygons  into  larger 
polygons,  thus  reducing  the  overall  polygon  count  in  a  simulator 
database.  Code  is  being  developed  by  K  Bryden,  B  Blau,  and  J  Chen.  A 
paper  is  also  being  prepared  describing  the  algorithm  and  should  be 
finished  by  the  end  of  January  1991.  These  tools  will  allow 
relaxation  of  MultiGen  format  terrain  files. 


Current  Problems: 

We  submitted  a  request  to  BBN  on  11 -November  to  establish  a 
consulting  contract  with  1ST.  Last  month  I  reported  that  we  had  no 
response  from  BBN.  This  is  still  true.  As  we  continue  to  use  BBN’s 
software  and  hardware,  our  needs  from  BBN  will  be  small  but 
increasing.  We  must  forge  some  sort  of  working  relationship  with 
them  in  order  to  avoid  a  slow  reverse-engineering  process. 


UNIVERSITY  OF  CENTRAL  FLORIDA 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 

1 2424  RESEARCH  PARKWAY,  SUITE  300,  ORLANDO,  FLORIDA  32826  (407)  658-5000 


December  27,  1990 

PM  TRADE 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Raymond  F.  Green  AMCPM-TND-FT 

Subject:  BAA  89-01  Monthly  Progress,  Status  and  Management  Report 

Reference:  Contract  N61339-90-C-0042  (CDRL  AOOl) 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress,  Status 
and  Management  Reports  and  Cost  Reports  for  Task  1  and  2  for  the  December  1990  time  period 
are  forwarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  call  me  at  658-5014  or  658-5000. 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


UNIVERSITY  OF  CENTRAL  FLORIDA 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 
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December  28,  1990 


PM  TRADE 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Raymond  F.  Green  AMCPM-TND-ET 

Subject:  BAA  89-01  Monthly  Progress,  Status  and  Management  Report 

Reference:  Contract  N61 339-90-C-0042  (CDRL  AOO 1 ) 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Dear  Mr.  Green: 

The  attached  Trip  Report  to  ETL  (Engineer  Topographic  Lab)  by  Curtis  Lisle  was  inadvertantly  left 
off  the  December  monthly  progress  report.  Because  the  information  is  current  and  relevant,  it  was 
decided  not  to  wait  for  next  month's  report . 

If  you  have  any  questions,  please  call  me  at  658-5014  or  658-5000. 


Sincerely, 


Ernie  Smart 
Program  Manager 


cc:  Dr.  Ronald  Hofer 

Mr.  Stan  Goodman 
Mr.  Karl  Driskell 
Mr.  Gene  Wiehagen 
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AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


Trip  Report 


Dates: 

Location: 

1ST  Personnel: 


December  10-14,  1990 

Army  Engineer  Topographic  Lab  (ETL) 
Ft.  Belvoir,  VA 

Curtis  Lisle 


Persons  Visited:  George  Lukes  (ETL) 

Doug  Carl  (ETL) 

Jay  Banchero  (BBN) 


Purpose: 

The  purpose  of  the  trip  was  to  gather  as  much  information  as 
possible  about  BBN's  SI 000  modeling  environment.  1ST  and  ETL 
agreed  that,  by  imbedding  me  in  their  database  development  project, 
I  could  learn  the  SI 000  tools  and  they  would  benefit  through 
increased  progress  on  their  project. 

This  document  is  divided  into  two  sections.  The  first  (brief)  section 
covers  the  itinerary  of  the  week  I  spent  at  ETL.  The  second  section 
outlines  many  of  the  major  pieces  of  information  acquired  through 
training,  experience,  or  discussions  with  ETL  employees. 


Itinerary: 

12/10/90  -  arrived  at  Washington-National  at  10:30 

George  Lukes  said  meet  after  lunch,  arrived  at  1:30 
met  with  George,  Jay,  Doug  for  an  introduction. 

12/11/90  -  trained  on  the  SI 000  Model  tool  in  the  morning; 

Gathered  DB  source  data;  began  modeling  static  objects. 

12/12/90  -  Modeled  buildings  and  placed  models  on  terrain  with 
the  assembly  tool.  Compiled  a  test  database.  We  could 
not  move  the  DB  over  to  the  CIG  because  of  problems 
with  the  Masscomp  host. 

12/13/90  -  Placed  our  buildings  on  the  final  database  according  to 
SPOT  image  coordinates  and  the  road  networks  already 
in  the  database.  Used  the  CIG  to  fly  over  the  test 
database  and  see  our  models.  Compiled  the  final 
database.  Met  with  George  Lukes  to  discuss  ITD, 


GIS  systems,  ETL  and  1ST  cooperation,  etc. 

12/14/90  -  Flew  over  the  final  database  on  the  CIG.  Jay  taught  us 
the  process  for  constructing  multiple  LOD  and 
articulated  models.  Jay  showed  me  the  process  for 
transferring  and  loading  databases  on  the  CIG. 


Concepts  Learned  at  ETL: 

Cartography: 

1.  Problems  occur  at  the  boundaries  between  UTM  zones  since  the 
Earth  bends  away  from  the  straight  UTM  coordinates. 


If  a  database  extends  across  a  UTM  boundary,  the  boundary  is 
usually  moved  until  the  entire  database  is  contained  in  one  UTM 
area.  The  limit  of  this  fudge  is  about  40  km.  before  the  error  gets  too 
large.  This  is  necessary  because  UTM  coordinates  are  derived  by 
converting  from  Geodetic  coordinates.  The  position  of  the  SouthWest 
comer  of  each  zone  is  calculated  then  offsets  are  measured  from 
imagery,  maps,  etc.  to  find  the  final  positions.  When  a  boundary  is 
“extended”  as  shown  below,  this  means  features  in  the  new  zone  are 
positioned  as  offsets  with  respect  to  the  base  location  of  the  adjoining 
zone  (which  would  only  be  accurate  if  the  Earth  was  flat). 


Real  UTM  zone  boundaries 

^  N*. 

>  i 


2.  The  Kuwait/Iraq  area  of  the  Middle  East  lies  across  UTM 
boundaries.  UTM  zones  are  every  8x6  (Doug  Carl’s  guess). 

3.  Different  data  sources  ("datum's")  do  not  agree  on  their 
positioning,  i.e.  SPOT  imagery  may  not  have  the  same  positioning  as 
European  1:50k  maps.  This  means  the  actual  constructed  database 
up  to  the  modeler  and  may  be  inaccurate. 

4.  Unclassified  source  data  is  usually  not  high  enough  detail  to  craft 
an  accurate,  good  looking  DB  (database)  for  ground  battle  rehearsal. 
Different  sources  available: 

1:50000  maos-  high  resolution  maps  which  shows  some 
cultural  features  (buildings,  docks,  roads,  etc) 

SPOT  imagery  -  French  satellite  photos  which  are  useful 
because  they  are  marked  with  coordinates  already  (easy  to 
correlate).  Resolution  is  good  enough  to  find  coastlines,  land 
features,  large  buildings,  etc.  Useful  for  direct  digitizing  of 
roads. 


■TOG  map  -  (Joint  Operations  Graphic)  This  is  a  military  map 
which  is  usually  at  1:250k  scale  and  is  designed  to  coordinate 
multiple-service  operations  (Army,  Navy,  etc.). 

TPC  map  -  (Tactical  Pilots  Chart)  1:500k  showing  only 
pipelines,  power  wires,  bodies  of  water,  etc.  This  is  often 
digitized  from  the  JOG  hardcopy,  so  it  is  not  a  good  "second 
opinion"  for  JOG  data. 

Tourist  info  -  Shows  pictures  of  major  buildings,  locations  of 
attractions,  museums,  etc.  This  was  useful  for  the  Desert  Shield 
operation  in  Kuwait  City  since  tourist  maps  and  books  were 
available. 

Classified  Sources  -  Imagery  at  higher  resolution  is 
available  from  classified  sources.  This  format  would  be  used  if 
the  highest  possible  detail  was  desired  for  mission  rehearsal. 

5.  The  time  the  image  or  map  was  made  is  often  important.  Water 
bodies  change  shapes,  construction  projects  remove  islands,  etc. 
Example:  flooded  regions  between  Iraq  and  Iran  were  constructed 
during  the  Iran/Iraq  war.  Finding  up-to-date  sources  is  a  serious 
problem.  Below  is  an  example  of  the  same  lake  taken  in  areal  shots 
at  two  different  times  (the  second  may  be  during  a  drier  season). 

The  database  modeler  must  make  decisions  about  which  source  to 
follow  in  situations  like  this: 


Contacts: 


George  Lukes  (355-2818)  is  the  manager  of  visual  DB  development 
operations. 

Doug  Carl  (355-3714)  has  a  mapping  and  image  extraction 
background.  He  provided  LandSat  imagery,  SPOT  photos,  tourist 
maps,  etc. 

Jay  Banchero  (355-3494)  is  a  BBN  modeler  with  art  background.  He 
has  used  SI 000  for  the  last  three  years  and  is  very  familiar  with 
database  construction  issues.  He  created  a  SIGgraph  88  piece  in  the 
Video  Show. 

Ellen  Kay  Project: 

Ellen  Kay  is  developing  the  process  to  import  ITD  data  into  the  SI 000 
database  environment.  They  will  be  using  Arcinfo  as  an 
intermediate  step.  ETL  is  contracting  the  ITD  work  to  Ellen  Kay, 
currently  they  are  not  planning  to  develop  the  process  themselves. 
Ellen  Kay  will  be  importing  ITD  for  the  Ft.  Hood,  Texas. 

Using  Arcinfo  has  an  advantage  because  it  imports  and  exports  in 
ADWAMS  format  (a  simple  early  GIS  format  which  is  pseudo¬ 
standard).  Landsat,  SPOT,  and  classified  sources  can  all  be  supplied 
in  ADWAMS  format  by  a  new  photogrammetry  station  (DSPW) 
designed  by  General  Dynamics.  Ray  Green  is  familiar  with  this 
project.  ISTIVSL  could  substantially  benefit  by  acquiring  the  DSPW 
workstation. 

The  ITD  data  format: 

Doug  Carl,  ETL,  formerly  with  DMA,  was  active  in  the  design  of  ITD 
data  while  at  DMA.  ITD  is  a  vector-based  data  which  takes  the  form 
of  several  separate  files,  each  containing  data  from  a  single  map 
overlay,  i.e.  one  file  for  roads,  one  file  for  canals  and  rivers,  etc.  The 
user  of  the  data  must  combine  these  separate  files  into  a  visual 
database.  Power  line  and  pipeline  overlays  are  not  included  in  ITD. 

The  vector  data  can  carry  any  number  of  attributes  belonging  to  two 
categories:  descriptive  (hard,  soft)  or  numeric  (10m  high).  The  data 
is  encoded  in  “standard  linear  format”  in  40  byte  blocks.  Block  types 
can  be  one  of  the  following  types: 

DSI  block  -  header  /  table  of  contents  packet 

segment  block  -  coordinate  value  (a  location) 
feature  -  feature  data  and  attributes 

text  -  descriptive  text  for  user  info 


The  ITD  format  evolved  because  of  the  need  for  TTD  (Tactical  Terrain 
Data  )  to  support  military  operations.  TTD  is  very  laborious  to 
prepare  and  contains  a  HUGE  amount  of  data.  Doug  Carl  said  a  15’  x 
15’  cell  took  2800-3200  hours  to  prepare  by  hand.  The  goal  of  ITD  is 
to  accelerate  the  preparation  time.  DMA  would  like  to  prepare  TTD 
for  battlefield  areas,  but  it  is  Doug  Carl’s  opinion  that  this  may  never 
be  accomplished  since  it  is  a  complex  process. 


SIOOO  Model  Tool: 

The  file  hierarchy  of  an  articulated,  multiple  LOD  file  is  shown  below. 
The  hierarchy  is  constructed  by  specifying  linkages  between  the  file 
types  shown. 


.lod  file 

.m2  file  .m2  file 


Naming  Convention: 

.m2  -  Geometry  files  which  are  created  to  represent  a  single  LOD  for 
a  polygonal  model  have  the  format 

“<modelname>_<revision>_<LODnum>.m2”.  For  example,  the  file 
“bldg_hanger_a_l.m2”  is  the  a-th  revision  of  the  LOD  =  1  model  for  a 
hanger  building. 

JM  -  This  file  contains  the  linkage  hierarchy  of  separate  “.m2” 
geometry  files.  Each  file  has  a  relative  position  offset. 

.mid  -  multiple  level  of  detail  model  file.  This  file  contains 
pathnames  which  provide  a  linkage  between  the  separate  LOD  files. 


.mid  file 


.lod  file 


.lod  file 


/\  /\ 

.m2  file  .m2  file  ,in2  file  >*”2  file 


Polygon  count  guidelines: 


Since  the  CIG  pages  the  database  in  dynamic  pieces  called  “load 
modules”  while  it  is  flying,  a  DB  designer  needs  to  be  concerned  only 
about  the  capacity  of  each  load  module  (500  meters  x  500  meters) 
and  the  overall  capacity  of  the  IG  (around  1000  polygons),  which 
could  be  viewing  several  load  modules  simultaneously: 


The  design  guidelines  we  were  given  are  as  follows: 

-  40  polygons/load  module  for  static  culture  including 
buildings  and  networks  (roads,  rivers,  etc). 

-  32  polygons/load  module  for  terrain 

These  limits,  which  seem  quite  low,  allow  for  around  50  dynamic 
objects  to  be  on  the  terrain  in  this  load  module  without  overloading 
the  CIG  capacity.  Therefore,  the  capacity  can  be  seen  as 

40  polys  for  culture 
32  polys  for  terrain 

1000  polys  for  models  (50  models  at  20  polys/model) 


1072  polys  total 

For  this  scenario,  it  is  obvious  that  the  CIG  can  display  only  a  single 
load  module,  but  the  terrain  database  is  built  to  support  LOTS  of 
moving  models  over  it’s  surface.  The  “simple  terrain  with  gobs  of 
moving  models”  method  of  terrain  DB  construction  seems  to  be  BBN’s 
style  of  thinking.  With  the  modelling  performed  at  ETL,  we  could  get 


fairly  dense  looking  cities  because  the  underlying  terrain  was  quite 
flat  (needing  only  1  or  2  polys  for  a  125x125  meter  square). 

When  designing  multiple  LOD  models,  the  polygon  count  of  the 
models  should  take  into  account  the  largest  screen  dimension 
possible  on  the  CIG  (640x480).  If  models  don't  cause  an  overload  in 
this  case,  then  they  won't  on  smaller  dimension  channels  either  (like 
the  Ml  with  its  tiny  channels!).  The  reverse  condition  is  what  causes 
a  problem:  a  high  polygon-count  model  could  look  allright  on  the  Ml 
CIG  but  cause  overload  problems  on  a  stealth  vehicle  with  its  larger 
channels. 

SIOOO  Network  Features: 

Networks  are  added  in  the  SIOOO  Assembly  tool  and  are  used  to 
represent  all  roads  and  rivers,  power  lines,  pipelines,  and  political 
boundaries. 

Generic  models,  like  power  poles,  are  usually  placed  according  to  the 
networks  in  the  database.  This  is  currently  a  manual  process  where 
the  modeler  views  the  network  vectors  on  the  SIOOO  workstation 
and  places  generic  models  by  eye  near  the  network  feature. 

Software  is  being  developed  to  allow  auto-placement  of  models  along 
the  network.  This  involves  querying  the  network  position  and 
orientation,  getting  a  distance  between  objects,  and  automatically 
placing  them. 

SIOOO  suffers  from  a  limitation  in  mapping  networks  to  polygons. 
Usually  a  textured  polygon  is  repeated  along  the  extent  of  a  network. 
In  the  case  of  a  road,  the  polygon  has  skid  marks  and  a  yellow  line 
down  the  middle.  The  problem  is  encountered  at  the  intersection  of 
non-perpendicular  networks.  The  polygons  mapped  to  the  network 
overlap  as  shown  in  the  diagram  below  and  create  a  noticable  visual 
anomaly: 


Visible  overlap  region 


Smaller  overlap  region 


This  problem  is  generally  handled  by  forcing  perpendicular 
intersections  —  a  process  which  must  be  done  interactively  by  a 
modeler  (time  consuming  for  a  large  database). 


Texture  Mapping  in  SIOOO: 

Each  polygon  in  SIOOO  has  the  option  of  being  assigned  a  flat  RGB 
color  or  being  textured  with  a  pre-loaded  texture  pattern,  the  SIOOO 
texture  patterns  are  color  maps  with  4-bit  intensity  values.  When  a 
colored  texture  pattern  is  applied,  the  polygon  automatically  takes  on 
the  color  and  intensity  of  the  pattern.  This  works  differently  than 
the  standard  black  &  white  texture  method  where  the  texture  map  is 
treated  as  an  intensity  and  only  varies  the  color  already  given 
separately  to  the  polygon.  The  black  &  white  method  is  used  in  the 
GE  Compuscene-IV,  E&S-500,  and  Redifusion's  CT-5,  CT-6  (also  made 
by  E&S). 

Texture  mapping  is  accomplished  in  the  SIOOO  system  by  defining  a 
hypothetical  texture  space.  A  textured  polygon  or  group  of  polygons 
can  be  placed  inside  this  space  and  they  will  acquire  whatever 
texture  is  projected  upon  them. 


Texture  Space 


Polygon  in  space  with 
own  local  coordinate  system 

This  can  best  be  visualized  by  the  above  diagram  where  the  texture 
map  is  projected  onto  a  far  wall.  Any  textured  polygons  can  be 
inserted  anywhere  in  the  projection  pyramid  and  oriented  as 
desired.  The  orientation  and  size  of  the  texture  space  is  defined  first 
by  picking  3  points  in  world  coordinates  to  define  the  corners  of  the 
base  of  the  texture  space  (referred  to  as  the  “base”,  a  ,  and  p  points). 
This  becomes  the  “current”  texture  space  and  is  mapped  onto  any 
number  of  polygons  desired.  The  texture  space  can  be  redefined  any 
time  a  modeler  desires.  Normally  the  texture  space  is  defined  once 
for  each  set  of  parallel  polygons  so  no  scew  effect  is  visible. 

The  texture  space  can  be  considered  infinitely  repeating.  If  a 
polygon  is  outside  of  the  shown  pyramid,  it  will  acquire  the  texture 
according  the  repeating  of  the  texture  space  (sort  of  like  a  3D 
modulus  operation). 


Repetitions  of 
texture  space 


A  SIMNET  CIG  hardware  limitation  exists  allows  for  only  four 
repetitions  of  the  texture  space.  Therefore,  the  most  you  can  make  is 
four  copies  of  a  texture  map  along  any  axis  in  texture  space. 

Restated,  a  polygon  on  the  CIG  can  never  have  a  texture  pattern 
repeat  more  than  four  times  in  either  axis  (a  square  could  have  4x4 
for  16  total  patterns). 


GIS  History  and  Issues: 

George  Lukes  believes  (and  I  agree)  that  a  terrain  database  system 
must  manage  its  information  in  a  GIS-like  way.  This  means  the 
database  system  should: 

•  Allow  multiple  input  sources  (images,  maps,  etc.) 

•  Provide  a  means  of  adding  attributes  (material,  hardness,  etc) 

•  Have  a  flexible  interior  data  structure  which  supports  vector 
data  (roads,  pipelines)  and  also  handles  polygons  for  the  IG. 

•  Support  both  mapping  (cartography)  and  CAD  (computer 
graphics)  applications. 

Integraph  tried  several  years  ago  to  incorporate  both  CAD  and 
mapping  technology  in  a  project  called  TIGris  (sp?)  or  Mini-TOPO. 


This  was  supposed  to  be  a  three  dimensional  GIS  system.  According 
to  George  Lukes,  it  never  succeeded  because  it  was  too  ambitious. 

ADWAMS  is  a  simple  GIS  format  originally  developed  to  represent 
wetlands  in  the  US  (by  the  Forestry  service?).  It  was  originally 
composed  of  two  separate  projects:  a  mapping  system  called  MOSS 
and  a  digitizing  and  importing  system  called  AMS.  Since  it  is  a 
simple  format,  it  is  a  defacto  standard  for  data  interchange  between 
GIS  systems.  ADWAMS  supports  points  and  triplets  with  attributes, 
strings  of  features,  and  outputs  in  a  polygonal  representation. 
ARCINFO  imports/exports  this  format. 

Arcinfo  is  a  traditional  GIS  program  which  has  previously  been 
used  on  several  Army  programs  and  has  a  following  of  users.  It  is  a 
good  choice  of  GIS  primarily  because  it  is  established  in  the  industry. 
It  does  not  address  the  powerful  merging  of  map  (2D)  and  CAD  (3D) 
information  particularly  well. 

DSPW  is  a  photogrammetry  station  developed  by  General  Dynamics 
(referred  to  during  the  section  on  the  Ellen  Key  project).  This  station 
is  composed  of  photogrammetric  and  GIS  software  running  on  a  Sun- 
4  platform.  It  is  designed  in  a  modular  style  with  a  suite  of  tools  to 
import  data  from  Landsat,  SPOT,  Arcinfo,  and  ADWAMS  sources.  It 
also  imports  from  several  classified  sources.  George  Lukes  informed 
me  that  Ray  Green  knows  about  this  station  and  is  interested  in 
getting  this  for  ISTIVSL,  but  we  need  to  acquire  someone  with 
photogrammetry  and  cartography  background  before  we  could  use  it. 


Conclusion: 

I  received  training  on  the  BBN  SI 000  tools  and  learned  about  BBN’s 
database  development  process  through  discussions  with  Jay 
Banchero.  I  was  made  aware  of  some  of  the  cartographic  issues 
which  need  to  be  addressed  during  database  construction  by  the  ETL 
employees. 

This  was  a  useful  trip  because  of  both  the  SI 000  training  and  the 
beginning  of  cooperation  between  IST/VSL  and  ETL. 
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1  Introduction 


The  goal  of  the  stereo  vision  is  the  recovery  of  three-  dimensional  information  from  images 
taken  from  different  viewpoints.  Two  cameras  located  at  two  positions  can  be  used  to  take 
two  images,  or  one  camera  can  be  used  to  take  two  images  from  two  different  positions.  As 
one  takes  images  of  an  object  from  two  different  positions,  the  object  is  shifted  in  one  image 
relative  to  that  in  other  image.  This  shift  is  inversely  proportional  to  the  depth  of  the  object, 
which  is  the  distance  of  the  object  from  camera.  We  call  this  shift  disparity,  and  hence  it  is 
the  measure  of  three  dimensional  depth. 

The  basic  problem  in  stereo  is  that,  one  has  to  match  a  point  from  the  left  image  to  a 
point  in  the  right  image.  One  point  in  the  left  image  can  correspond  to  only  one  point  in 
the  right  image.  The  problem  of  matching  a  point  from  left  image  to  a  point  in  the  right 
image  is  called  correspondence  problem.  All  the  stereo  algorithms  try  to  solve  this  problem. 

If  we  take  two  images  with  the  cameras  which  are  aligned,  the  matching  problem  can  be 
restricted  to  one  dimensional  search  along  any  row,  i.e.  we  do  the  matching  of  the  points  in 
the  same  row  in  both  images,  we  don’t  match  a  point  in  one  image  to  the  point  in  other 
image  which  is  not  in  the  same  row.  This  constraint  is  known  as  epipolar  constraint . 

Establishing  correspondence  problem  is  the  main  task  in  a  stereo  algorithm,  this  involve 
two  questions:  what  to  match?  and  how  to  match?  Correspondence  between  two  images 
can  be  established  by  matching  specific  features  such  as  blobs  or  edges,  or  by  matching 
small  regions  by  direct  correlation  of  image  intensities  without  identifying  features.  After 
feature  matching,  the  next  step  in  stereo  is  to  apply  continuity  constraint,  which  states  that 
disparity  varies  smoothly  almost  everywhere,  and  that  only  a  small  fraction  of  the  area  of 
an  image  is  composed  of  bounderies  that  are  discontinous  in  depth  .  When  disparities  at 
some  points  are  not  known,  a  surface  between  known  disparities  can  be  interpolated  using 
the  smoothness  criterion.  Since  these  disparities  are  direct  measure  of  the  depth,  we  can 
interpolate  a  surface  going  through  all  points  with  given  disparities. 

This  report  summarizes  our  work  during  the  first  year  of  this  project.  The  first  six  months 
of  this  project  were  devoted  to  the  literature  search  on  the  stereo  algorithms.  A  number 
of  recent  papers  from  the  current  literature  were  studied  and  their  approaches  analyzed. 
Three  representative  algorithms  were  selected  for  further  study.  During  the  next  six  months 
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the  algorithms  were  implemented,  and  tested  on  a  representative  set  of  stereo  pairs.  This 
report  describes  our  experiments,  and  the  comparitive  study  of  these  algorithms.  During  the 
second  year  of  this  project  we  will  focus  on  improving  these  algorithms  by  incorporating  the 
smoothness  and  continuity  criteria.  We  will  also  attempt  to  introduce  some  other  3D  cues 
like  shading  in  the  stereo  algorithms.  It  is  expected  that  the  performance  of  such  method 
using  multiple  cues  will  be  much  better  than  the  one  using  only  single  cue.  We  will  also 
start  an  initial  study  related  to  interpolation  of  surface  from  the  dispariy  maps. 

In  the  next  section,  we  will  discuss  three  stereo  algorithms  ;  Normalized  Correlation 
Method,  Difference  Method  and  Prazdny’s  Method.  Section  3  presents  the  results  obtained 
for  several  images  with  these  algorithms.  We  end  this  report  with  section  4  which  conclude 
this  report.  We  have  also  included  the  source  codes  of  three  algorithms,  and  Canny’s  edge 
detector  written  in  C  language  in  the  Appendix  A.  This  will  make  it  easy  to  run  these 
algorithms  on  any  other  system  for  further  experimentation.  In  addition,  the  demos  for 
running  our  programs  are  given  in  the  Appendix  B. 

2  Algorithms 

The  three  algorithms  which  are  used  here,  basically  try  to  match  corresponding  points  in 
images  and  get  the  difference  in  their  positions,  which  as  explained  in  previous  section  is 
measure  of  the  distance  of  a  point  in  the  object  from  camera.  Cochran  and  medioni  [2], 
have  proposed  an  algorithm  which  declares  a  point  as  corresponding  point  to  a  ipoint  at 
which  highest  Normalized  correlation  is  obtained.  The  algorithm  reported  by  Kayalap  [3], 
takes  sum  of  the  absolute  difference  of  the  intensities  of  the  neighbouring  points  of  a  point  in 
the  left  image  to  the  corresponding  neighbouring  points  of  a  point  in  the  right  image.  The 
point  in  the  right  image,  which  gives  the  minimum  sum  of  difference,  is  the  matching  point. 
Prazdny’s  [1]  algorithm  chooses  a  matching  point  which  gets  the  maximum  support  from  its 
neighbours. 

Each  of  the  algorithm  is  discussed  briefly  in  the  following  sections. 
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2.1  Normalized  Correlation  Method  (Cochran  and  Medioni) 

In  this  method,  to  match  a  point  x  in  the  left  image  to  the  point  y  in  the  right  image, 
we  first  get  the  mask  of  given  size  around  x.  Then  we  compute  the  normalized  correlation 
of  that  mask  with  the  mask  around  point  y  in  the  right  image.  The  point  y  at  which  we 
get  the  maximum  normalized  correlation  value  is  the  matching  point.  The  difference  in  the 
position  of  x  and  y  is  the  disparity  value  for  x.  If  multiple  points  with  maximum  normalized 
correlation  values  are  obtained,  we  select  one  disparity  value  for  the  point  x,  based  on  the 
smoothness  criterion.  The  smoothness  criterion  assume  that  a  point  x  has  almost  the  same 
disparity  value  as  of  its  neighbouring  points.  Finally,  the  edgels  from  the  original  intensity 
images  can  be  extracted,  and  used  for  possible  locations  of  the  depth  discontinuties. 

In  order  to  get  disparity  for  a  point  {x,y),  we  compute 

A{xi,y)  = 

,  ,  T.T,-„Z^-„L(^  +  l=,y+i)xRi^i  +  l=,y  +  j) 

- - A{^) - 

where 

X  “  d  ^  X{  ^  X  "f"  d, 

d  is  the  disparity,  m  is  the  mask  size,  L{x,y)  and  R{x,y)  respectively  are  the  gray  values  in 
left  and  right  image  at  {x,y).  The  point  (x,-,t/)  at  which  value  of  c{xi,y)  is  maximum  is  the 
matching  point  for  {x,y),  and  x;  —  x  is  the  disparity  value  for  {x,y). 

2.2  Sum  of  Absolute  Difference  Method  (Kayalap) 

This  method  is  based  on  sum  of  absolute  differences  of  intensity  values  around  the  small 

neighborhood  of  the  two  points  in  the  left  and  right  images.  To  get  a  point  y  in  the  right 

image  corresponding  to  the  point  x  in  the  left  image,  first  the  mask  of  given  size  around  x  is 

obtained.  Then  the  sum  of  absolute  differences  (SAD)  of  this  mask  with  the  mask  centered 

around  point  y  in  right  image  is  computed.  The  point  in  the  right  image  which  has  minimum 

SAD  is  the  point  y  matched  to  the  point  x  in  the  left  image.  The  difference  in  the  position  of 

X  and  y  is  the  disparity  for  x.  The  disparity  for  all  the  points  in  the  left  image  are  computed 
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in  the  similar  fashion.  In  this  case  also,  we  may  get  multiple  points  with  the  same  SAD  for 
a  point  X.  The  smoothness  criterion  can  be  used  to  to  resolve  the  disparity  conflict. 

The  disparity  for  a  point  {x^y)  is  computed  as  follows: 

m  m 

D{xi,y)=  +  +  + 

j=—m k=—m 

where 

X  —  d<Xi<x  +  d, 

d  is  the  disparity  and  m  is  the  mask  size.  The  point  (x,-,?/)  at  which  the  value  of  D{xi,y)  is 
minimum  is  the  matching  point  and,  a:,-  —  x  is  the  disparity  value  for  ix,  y). 

2.3  Prazdny’s  Method  (  Prazdny) 

In  this  method,  the  disparity  is  computed  at  edge  points  only  unlike  the  previous  methods 
where  the  disparity  was  computed  for  each  point.  Therefore,  the  first  step  in  this  method  is 
to  apply  the  edge  detector  to  left  and  right  images.  Prazdny’s  method  is  based  on  smoothness 
criterion.  The  point  under  consideration  should  have  the  same  disparity  value  as  of  most  of 
its  neighbours.  This  implies  that  the  neighbours  should  support  a  disparity  value  for  a  point 
under  cosideration.  Prazdny  has  given  an  expression  which  calculates  support  for  a  disparity 
value  of  a  point  based  on  above  criterion.  This  expression  is  called  similarity  function.  The 
sum  of  similarity  function  for  each  possible  disparity  is  calculated.  A  final  disparity  value 
for  which  this  summation  is  maximum  is  assigned  to  the  point. 

The  similiarity  function  should  meet  three  requirements  : 

1.  The  disparity  similarity  function  should  be  inversely  proportional  to  the  difference  of 
disparities  of  interacting  points. 

2.  More  distant  points  should  exert  less  influence  while  nearby  points  should  have  more 
disambiguiting  power. 

3.  The  more  distant  the  two  interacting  points  are  the  less  seriously  should  their  dispar¬ 
ity  difference  be  considered.  Because  of  inherent  uncertainity  :  steeply-sloped  surfaces 
will  generate  large  disparity  differences  which  should  nevertheless  contribute  to  disam¬ 
biguation.  For  large  seperations  one  should  probably  expect  a  flat  support  function. 


The  similarity  function  capturing  all  of  these  requirements  is  : 

Here,  s{i,j)  expresses  the  amount  of  support  disparity  D,-  at  point  i,  receives  from  dis¬ 
parity  Dj  at  another  point  j,  and  |  {i  —  j)  |  is  the  distance  between  two  points,  c  is  scaling 
costant,  usually  taken  between  0.55  and  0.85. 

The  first  step  in  this  method  is  to  compute  all  the  potential  disparities  for  each  point 
in  the  left  image.  We  will  explain  this  step  by  taking  an  example  in  one  dimension.  This 
example  can  easily  be  extended  to  two  dimensions. 

Let  0  denote  exclusive  nor  operation,  and  let  two  one  dimensional  images  of  size  1x5 
are 


left(L)  image 


0 

1 

1 

0 

0 

Right(R)  image 

0 

0 

1 

1 

1 

then  is  defined  as: 


C°{x,d)  =  L{x)  0  R{x  +  d) 

For  this  example  the  initial  disparity  map,  C°  is  given  by: 


1 

2 

3 

5 

2 

1 

1 

1 

1 

1 

1 

0 

1 

1 

-1 

-2 

1 
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The  first  column  (shown  in  bold)  represents  possible  disparity  values  ranging  from  -2  to 
+2  in  this  case.  While  the  first  row  (shown  in  bold)  denotes  the  x  location  of  a  point. 

The  disparity  values  influence  each  other  as  follows.  Suppose  that  a  left  image  feature 
point  at  location  i  has  a  set  of  possible  disparities  A  and  we  are  interested  in  the  amount  of 
support  a  particular  disparity  d,-  receives  from  the  feature  point  j  (  with  possible  disparity 
set  Dj  ),  which  is  neighboring  point  of  i.  First,  the  disparity  dj  from  set  Dj  of  point  j 
is  selected,  and  the  support  is  computed  using  similiarity  function.  In  the  same  way,  the 
support  for  a  disparity  value  di  is  computed  using  all  disparity  values  dj  of  all  neighbors  j 
of  point  i.  Then  all  these  supports  are  added  to  get  the  support  for  disparity  d,-  of  point  i. 
The  disparity  d,-  for  point  i  which  receives  the  maximum  support  is  the  final  disparity  value 
assigned  to  the  point  i. 
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3  Results 


The  algorithms  discussed  in  the  previous  sections  were  tested  on  a  set  of  six  stereo  pairs; 
Renault,  Sandwich,  Pentagon,  Sphere,  Ruts,  and  Rocks.  The  Renault  pair  shows  the  auto 
part  used  in  the  Renault  car,  while  the  Sandwich  pair  shows  a  Sandwich  resting  on  a  flat 
surface,  and  the  Pentagon  pair  is  an  aerial  view  of  the  Pentagon  with  some  cars  in  the 
parking  lot  in  the  background.  The  Sphere  pair  is  synthetically  generated  which  shows  a 
concrete  shpere  on  the  table.  Finally,  the  Ruts  and  Rocks  pairs  are  real  images  which  show 
respectively  the  mound  of  rocks,  and  ruts.  The  images  were  acquired  from  Professor  Ramesh 
Jain  at  University  of  Michigan,  Ann  Arbor.  The  original  images  were  of  the  size  512  x  512, 
but  were  reduced  to  128  x  128  for  timing  constraint.  All  the  algorithms  were  run  on  Sun 
SparcStation-1. 

3.1  Normalized  Correlation  Method 

The  results  are  shown  in  Figures  2-7.  The  informations  regarding  the  image  size,  disparity 
range,  masksize  and  cpu  time  in  seconds  are  given  in  the  table  showm  in  Figure  1. 

Disparity  map  for  the  Sandwich  image  shown  in  Figure  3(c),  is  almost  continouous  on  the 
surface  of  sandwich.  There  is  some  discontinuity  which  can  be  avoided  by  using  continuity 
criterion.  In  case  of  Pentagon  image  shown  in  Figure  4,  it  was  observed  that  smaller  mask 
size  gave  rise  to  the  finer  details  of  the  Pentagon  building.  However,  lot  of  discontinuities 
in  the  background  were  also  observed.  On  the  other  hand,  with  large  mask  size  the  finer 
details  were  lost  but  background  became  smoother.  Disparity  map  for  Renault  shown  in 
Figure  2(c)  does  not  have  much  discontinuity  on  the  surface  of  Renault,  and  for  larger  mask 
the  background  is  smoother  also.  The  disparity  maps  for  Sphere,  Ruts  and  Rocks  shown 
in  Figure  5(c),  6(c)  ,  7(c)  respectively,  are  not  of  good  quality.  It  is  difficult  to  perceive 
anything  significant  from  disparity  maps  of  Ruts  and  Rocks.  The  input  images  themselves 
are  very  difficult  to  analyze,  these  images  have  lot  of  symmetry.  In  this  case,  when  selecting  a 
particular  disparity  value  the  algorithm  encourages  multiple  matches.  Therefore,  the  results 
are  not  good. 
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Figure 

Image 

Size 

Disparity  Range 

2 

Sandwich 

128  X  128 

13 

11 

782 

3 

Pentagon 

128  X  128 

4 

11 

257 

4 

Renault 

128  X  128 

10 

11 

609 

5 

Sphere 

128  X  128 

17 

11 

2114 

6 

Ruts 

128  X  128 

17 

11 

1004 

7 

Rocks 

128  X  128 

38 

11 

2049 

Figure  1:  Summary  of  result  for  Normalized  Correlation  Method. 
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(c) 

Figure  2;  Result  of  Normalized  Correlation  M(“thod  lor  Renault  Image,  (a)  Left  Image,  (b) 
Right  Image,  (c)  I)is])arity  Maju  Darker  i>arts  are  closer  to  the  viewer. 


(c) 


Figure  3:  Result  of  Normalized  Correlation  Method  for  Sandwich  Image,  (a)  Left  Image, 
(b)  Right  Image,  (c)  Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 
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(c) 


Figure  4:  Result  of  Normalized  Correlation  Method  for  Penatgon  Image,  (a)  Left  Imag( 
(b)  Right  Image,  (c)  Disparitj'  Map.  Darker  parts  are  closer  to  the  viewer. 


1.3 


(c) 

Figure  5;  Result  of  Normalized  Corndation  Method  for  Sphere',  (a)  Left  Image,  (b)  Right 
Image,  (c)  Disparit\’  Map.  Darker  j^arts  are  closer  to  tin*  viewer. 


1-1 


N".  V 


e  7:  liesull  of  Nornializ«'(l  (k)rn'lation  Method  for  Itocks  (a)  Left  Image,  (b)  Right 
e,  (c)  Disparity  Ma]).  Darker  parts  are  (]te>ser  to  the  \  ie\\('r. 


3.2  Difference  Method 


The  results  for  this  method  are  shown  in  Figures  9-14.  The  informations  regarding  the 
image  size,  disparity  range,  masksize  and  cpu  time  in  seconds  are  given  in  the  table  shown 
in  Figure  8. 

The  disparity  map  for  the  Sandwich  pair  is  shown  in  Figure  9(c).  It  is  clear  from  the  result 
that  some  of  the  details  are  missing,  which  can  be  filled  in  using  the  continuity  criterion. 

The  disparity  map  for  the  Pentagon  pair  shown  in  Figure  10(c)  does  not  contain  finer 
details.  The  results  for  the  Sphere  pair  shown  in  Figure  12(c)  are  very  good  with  this  method. 
The  sphere  is  clearly  visible. 

In  summary,  we  get  almost  similiar  results  with  this  method  as  compared  to  the  the 
correlation  method  discussed  in  the  previous  section.  However,  the  difference  method  is 
the  order  of  magnitude  faster  than  the  normalized  correlation  method.  The  normalized 
correlation  method  requires  additional  square  root  operation  for  each  point,  which  slows  it 
down. 
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Figure 

Image 

Size 

Disparity  Range 

Masksize 

Time{sec) 

8 

Sandwich 

128  X  128 

13 

11 

327 

9 

Pentagon 

128  X  128 

4 

11 

122 

10 

Renault 

128  X  128 

10 

11 

261 

11 

Sphere 

128  X  128 

17 

11 

391 

12 

Ruts 

128  X  128 

17 

11 

411 

13 

Rocks 

128  X  128 

38 

11 

800 

Figure  8:  Summary  of  Results  for  Difference  Method. 
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(c) 

Figure  9:  Result  of  Difference  Method  for  Sandwich,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 
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(c) 


Figure  10;  Result  of  Difference  Method  for  Pentagon,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 


(c) 

Figure  11:  Result  for  Difference  Method  for  Renault,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 
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(c) 

Figure  12:  Result  for  Difference  Method  for  Sphere,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 
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(c) 


Figure  13;  Result  for  DifTeixuice  Method  for  Ruts,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 
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(c) 


Figure  1-4;  Result  for  DifTerenee  Method  for  Rocks,  (a)  Left  Image, 
Disparity  Map.  Darker  parts  are  closer  to  the  viewer. 


(b)  Right  Image,  (c) 


3.3  Prazdny  Method 

The  results  obtained  with  Prazdny ’s  method  are  shown  in  Figure  16-21.  The  informations 
regarding  the  image  size,  disparity  range,  masksize  and  cpu  time  in  seconds  are  given  in  the 
table  shown  in  Figure  15.  The  value  of  constant  c  in  the  similiarity  function  is  taken  as  0.65. 
Canny’s  edge  detector  was  applied  to  get  the  negative  and  positive  edges  for  all  the  images. 

The  left  and  right  images  for  the  Sandwich  pair  are  shown  in  Figures  16  (a)-(b),  corre¬ 
sponding  edge  maps  are  shown  in  Figure  16(c)-(d),  and  the  disparity  map  is  shown  in  Figure 
16(e). 

The  results  for  the  Pentagon  pair  are  shown  in  Figure  17.  The  disparity  map  obtained 
for  this  pair  is  quite  good.  The  disparity  map  for  Renualt  pair  is  shown  in  Figure  18(e). 

Next,  the  results  for  the  Sphere  pair  are  shown  in  Figure  19.  From  the  edge  maps  of  this 
pair,  it  was  observed  that  disparity  for  this  pair  is  very  high.  Therefore,  a  high  disparity  value 
range  was  given  as  input  to  the  algorithm.  The  benefit  of  edge  based  method  is  that,  we  can 
easily  observe  from  edge  map  what  maximum  disparity  value  is  to  be  given  as  input.  For  this 
pair  we  get  much  better  result  as  compared  to  methods  discussed  in  previous  subsections. 

Quite  good  results  were  obtained  with  this  algorithm  for  Ruts  and  Rocks  stereo  pairs 
shown  in  Figures  20  and  21(e)  respectively,  as  compared  to  previous  two  methods. 
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Figure 

Image 

Size 

Disparity  Range 

16 

Sandwich 

128  X  128 

13 

11 

16 

17 

Pentagon 

128  X  128 

4 

11 

19 

18 

Renault 

128  X  128 

10 

11 

65 

19 

Sphere 

128  X  128 

13 

11 

29 

20 

Ruts 

128  X  128 

13 

11 

16 

21 

Rocks 

128  X  128 

13 

11 

18 

Figure  15;  Summary  of  results  for  Prazdny’s  Method. 
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(c)  (d) 


(e) 


Figure  16:  Result  for  Prazdny’s  Method  for  Sandwich  pair,  (a)  Left  Image,  (b)  Right  Image, 
(c)  Left  Edge  Map,  (d)  Right  Edge  Map.  Positive  edges  are  brighter  than  negative  edges, 
(e)  Disparity  Map  at  edge  points  only.  Brighter  edges  are  far  from  the  viewer. 


(e) 


Figure  17:  Result  for  Prazdny’s  Metiiod  for  Penatgon  pair,  (a)  Left  Image,  (b)  Right  Image, 
(c)  Left  Edge  Map,  (d)  Right  Edge  Map.  Positive  edge  are  brighter  than  negative  edges,  (e) 
Disparity  Map  at  edges  only.  Rrigli(<’r  edges  are  far  from  the  viewer. 
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(e) 


Figure  18:  Result  for  Prazdny’s  Method  for  Renault  pair,  (a)  Left  Image,  (b)  Right  Image, 
(c)  Left  Edge  Map,  (d)  Right  Edge  .Map.  Positive  edge  aie  brighter  than  negative  edges,  (e) 
Disparity  Map  at  edg(‘s  only.  llriglitcM' edges  are  far  fnun  the  viewer. 

2‘) 


(e) 


Figure  19:  Result  for  Prazdny’s  Method  for  Sphere  pair,  (a)  Left  Image,  (b)  Right  Image, 
(c)  Left  Edge  Map,  (d)  Right  Edge  Map.  Positive  edge  ar<'  brighter  than  negative  edges,  (e) 
Disparity  Map  at  edges  only,  llrightc'r  edges  are  far  from  the  viewer. 
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(e) 


Figure  20:  Result  for  Prazdny’s  Method  for  Ruts  pair,  (a)  Left  Image,  (b)  Right  Image,  (c) 
Left  Edge  Map,  (d)  Riglit  Edge-  Map.  Positive  edge  are  brighter  than  negative  edges,  (e) 
Disparity  Map  at  Edges  only.  Brighter  edges  are  far  from  the  viewer. 
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(e) 

Figure  21:  Result  for  Prazdn3^’s  Method  for  Rocks  pair,  (a)  Left  Image,  (b)  Right  Image, 
(c)  Left  Edge  Map,  (d)  Right  Edge  Map.  Positive  edge  are  brighter  than  negative  edges,  (e) 
Disparity  Map  at  Edges  only.  Brighter  edges  are  far  from  the  viewer. 
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4  Summary  and  Conclusions 


In  this  report  we  have  described  the  implementation  of  three  stereo  algorithms.  Two  algo¬ 
rithms  are  correlation  type,  while  the  third  one  is  edge  based.  The  algorithms  were  also 
tested  on  a  set  of  stereo  pairs,  and  compared  in  terms  of  cpu  time  and  the  overall  results. 
It  was  found  that  difference  and  normalized  correlation  methods  give  almost  similar  results, 
except  that  difference  method  is  order  of  magnitude  faster  than  the  normalized  correlation 
method. 

In  case  of  prazdny’s  method,  which  is  edge  based,  the  disparity  values  are  computed 
only  at  edge  points.  Therefore,  in  order  to  obtain  disparity  values  on  other  points  the 
surface  interpolation  is  necessary.  The  Difference  and  Normalized  Correlation  methods  don’t 
perform  well  for  the  textured  images.  However,  Prazdny’s  method  still  give  good  result  since 
it  computes  disparity  at  edge  points  only.  One  of  the  limitations  of  all  these  methods  is  that 
the  maximum  disparity  range  is  to  be  known  beforehand. 

The  execution  time  of  the  algorithms  reported  is  reasonable  for  image  size  of  128  x  128. 
But,  the  algorithms  will  slow  down  significantly  if  the  original  size  of  images  {512  x  512)  is 
used.  However,  the  execution  time  can  be  easily  reduced  to  few  seconds  by  using  additional 
hardware  boards  e.g.  Data  Cube  convolution  boards  for  the  Sun  Workstation. 

Our  future  work  will  focus  on  improving  these  algorithms  by  incorporating  the  smooth¬ 
ness  and  continuity  criteria.  We  will  also  study  some  other  3D  cues  like  shading^  and  attemp 
to  combine  these  cues  with  stereo.  It  is  expected  that  the  performance  of  such  method  using 
multiple  cues  will  be  much  better  than  the  one  using  only  single  cue.  We  will  also  start  an 
initial  study  related  to  segmentation  of  3D  surfaces  followed  by  the  interpolation  step. 
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Accomplishments 

1.  Sponsor  Demonstration  -  On  January  25,  VSL  held  a  demonstration  of 
all  PM-TRADE  funded  projects.  Included  in  this  was  the  first  exhibit  of  the 
software  which  was  created  under  the  Geospecific  Database  Project.  The 
two  major  components  of  the  software  were  shown.  Dr.  Shah’s  computer 
vision  analysis  of  stereo  images  and  Dr.  Boyer’s  vision  analysis  of  shadows. 
The  first  set  of  programs  demonstrated  the  data  path  from  stereo  images 
(using  three  different  stereo  techniques)  to  CAD  database  to  flight.  The 
second  set  of  programs  shows  shadow  analysis  straight  to  flight. 

2.  General  Electric  -  On  January  31,  part  of  the  VSL  went  to  General 
Electric  to  start  a  basic  working  communication  and  propose  some 
combined  work.  The  main  intent  of  going  to  GE  in  terms  of  this  project  was 
looking  specifically  at  the  TARGET  database  product.  The  people  at  GE  gave 
us  a  very  informative  demonstration  of  this  software  package.  This 
database  tool  is  important  because  it  has  the  same  family  of  problems 
associated  with  the  Geospecific  project.  Hopefully  more  information  about 
this  product  will  be  coming. 

3.  First  Year  Objectives  -  January  was  the  end  of  the  first  year  of  this 
project.  During  this  month  was  mostly  cleanup  of  the  software  and 
documentation.  There  have  been  some  added  features  to  Lisle’s  ANIM 
program  which  give  a  better  view  of  the  database.  Also,  all  of  the 
documentation  has  been  completed.  We  have  received  a  summary  report 
from  Dr.  Shah  of  the  work  that  he  has  been  doing.  This  report  is  attached. 

Problems 

One  of  the  goals  previously  set  was  to  get  all  of  the  various  programs 
working  on  the  Silicon  Graphics  workstation  running  under  Xwindows. 

This  has  been  accomplished  for  most  of  the  programs.  There  still  are  some 
logistical  problems  which  will  take  some  time  to  work  out.  These  are  not 
problems  which  are  in  the  way  of  doing  work.  All  programs  work  correctly  as 
they  stand  now,  but  the  transition  to  Xwindows  will  take  some  time. 
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Accomplishments 

1.  Conducted  meetings  with  Dr.  Shah  about  plans  for  the  second  year  of 
work  on  the  project.  Shah’s  work  is  summarized  as  follows  : 

•  Continue  implementations  of  stereo  algorithms 

•  Perform  experiments  with  different  types  of  stereo  images, 
specifically  those  involving  buildings 

•  Comparative  study  of  different  stereo  techniques 

•  Improve  depth  maps  by  introducing  constraints  on  the  stereo 
algorithms,  for  example,  applying  edge  based  constraints 

•  Fit  planar  and  quadratic  surfaces  to  the  models  derived  from 
the  stereo  images 

2.  Plans  for  a  meeting  with  Dr.  Boyer  have  been  delayed  until  the  first  week 
in  March,  due  to  travel  by  Boyer.  Plans  for  discussion  are  about  the  shadow 
work  to  be  done  in  the  next  year.  Boyers  plans  for  this  year  will  be  included 
in  next  months  report. 

3.  Blau  has  conducted  some  limited  experiments  on  different  types  of  stereo 
images.  This  is  to  help  Shah  and  his  student  better  define  the  constraints 
which  must  be  added  to  their  programs. 


Problems 

There  are  no  problems  at  this  time. 
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Project:  Multiple  Image  Generator  Databases  (MIDB) 

Project  Lead:  Curtis  Lisle 

Accomplishments:  Several  separate  efforts  are  underway  within  the  MIDB 
project.  Major  developments  for  each  area  are  listed  separately. 

1.  SIMNET  Databases:  Lisle  and  Mode  have  constructed,  loaded,  and  viewed  an 
articulated,  multi-LOD  model  of  a  HMMWV  vehicle  on  IST’s  SIMNET.  This  vehicle 
served  as  a  test  case  for  the  development  of  dynamic,  3-dimensional  models  in  the 
SIMNET  environment.  We  can  compile  DED  (dynamic  element  databases) 
composed  of  3D  models  into  a  run-time  format  and  view  them  on  the  SIMNET 
system.  This  was  a  necessary  milestone  in  IST’s  understanding  of  the  SIMNET 
system  in  order  to  develop  databases  for  it. 

2.  MultiGen  to  ESIG  Interface:  In  our  last  report,  1ST  described  the  arrival  of 
software  from  Software  Systems  which  would  be  included  in  the  ESIG  formatter. 
Upon  our  first  review,  the  algorithm,  which  can  add  static  priority  to  any  arbitrary 
database,  will  be  hard  to  integrate  into  IST’s  formatter. 

3.  Project  2851: 1ST  is  considering  how  to  become  a  test  site  for  P2851  GTDB  data. 
We  are  in  negotiations  with  PRC,  MacLean,  VA.  over  this  issue  currently. 


Problems:  The  static  priority  database  requirement  for  the  ESIG-500  may  make 
automated  database  generation  for  it  difficult.  Investigation  is  underway  here. 
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Monthly  Report  March  1991 
Geospecific  Database  Project 
Project  Lead;  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

1.  Conducted  meetings  with  Dr.  Boyer  during  the  first  week  of  march  about 
plans  for  the  second  year  of  work  on  the  project  Their  work  is  summarized 
as  follows  : 

•  One  of  the  efforts  will  be  to  get  all  of  Boyers  software  working  on 
the  same  computer  platform  as  Shah  software.  There  was  an 
effort  during  the  last  part  of  the  first  year  to  accomplish  this 
task,  but  there  were  some  problems  with  operating  system 
software.  Solutions  to  these  problems  should  be  working 
within  the  next  2-3  months. 

•  Boyers  height  by  shadow  extraction  software  is  going  to  be 
enhanced  in  a  number  of  ways.  A  better  user  interface  is  going 
to  be  added  and  the  height  extraction  algorithms  are  going  to 
be  improved.  Automatic  detection  of  buildings  by  edge  finding 
will  help  the  user  decide  which  parts  of  the  image  contain 
buildings.  Along  with  the  improvements  in  the  human 
interface,  the  users  of  this  software  should  be  able  to  better 
build  databases  from  images. 

2.  Plans  are  to  attend  the  SPIE  AeroSpace  Sensing  ‘91  Photonics  Exhibition. 
We  are  able  to  attend  at  no  cost  because  the  university  is  a  partner  in  the 
production  of  the  exhibition.  Image  processing,  scanning  and  satellite 
imagery  will  be  some  of  the  features  that  we  will  look  at. 

Problems 

There  are  no  problems  at  this  time. 
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Project:  Multiple  Image  Generator  Databases  (MIDB) 

Project  Lead:  Curtis  Lisle 

Accomplishments:  Several  separate  efforts  are  underway  within  the  MIDB 
project.  Major  developments  for  each  area  are  listed  separately. 

1.  SIMNET  Databases:  A  complete  DED  (dynamic  element  database)  containing 
all  the  standard  SIMNET  models  (ml,  ah64,  m2,  etc.)  along  with  IST-developed 
models  for  an  NLOS  HUMMWV  and  FOG/M  missile  was  built  and  sent  to  Ft. 
Rucker  for  testing  on  the  NLOS  project.  The  NLOS  trainer  is  networked  to  existing 
SIMNETs  at  Rucker.  This  will  provide  proof  of  IST’s  capability  to  generate  workable 
polygon  models  of  vehicles  and  munitions  in  support  of  an  existing  SIMNET  site. 

More  progress  has  been  made  understanding  the  SIMNET  database  development 
process  using  SIOOO.  We  are  beginning  to  study  the  SIOOO  datafile  formats  for 
Integration  of  these  tools  into  IST’s  SimData  Center  toolset  (a  complete  database 
development  environment). 

2.  IST/Army  ETL  Meeting:  Jacki  Morie  met  with  Kevin  Muhm,  Rick  Herrmann  of 
ETL  and  Ray  Green  of  PM-TRADE.  We  discussed  future  cooperation  between  ETL 
and  1ST  for  visual  database  technology.  Specifically,  ETL  agreed  to  provide  the 
finished  Ft.  Hood  database  along  with  ITD,  DTED,  and  imagery  to  1ST.  These 
datasets  will  be  used  as  input  for  IST’s  SimData  Center  toolset.  Cooperation 
between  1ST  and  ETL  on  Project  2851  issues  was  also  discussed.  When  completed, 
ETL  will  provide  their  P2851  GTDB-to-Boeing  formatter  to  1ST. 

2.  MultiGen  to  ESIG  Interface:  In  the  February  91  report,  polygon  priority  for  the 
ESIG  database  was  identified  as  a  problem  we  encountered.  We  have  made 
progress  in  solving  this  using  the  programs  from  Software  Systems  (for  reference, 
see  February  91  report).  The  results  look  very  good:  We  have  correctly  “prioritized” 
most  of  the  Research  Park  database  previously  demonstrated  to  PM-TRADE. 

Correct  priority  order  from  any  viewpoint  is  provided  by  identifying  separating 
planes  which  allow  the  IG  to  display  features  in  the  correct  visual  order.  Previous 


to  this  month,  1ST  had  no  way  of  generating  separating  planes  from  a  MultiGen 
database. 


3.  Project  2851:  1ST  has  responded  to  the  Statement  of  Work  sent  by  PRC,  McLean, 
VA  requesting  sights  to  convert  P2851  GTDBs  for  display  on  various  IGs  (image 
generators).  In  our  discussions  with  PRC,  we  believe  UCF/IST  has  a  good  chance  to 
be  funded  by  P2851  to  convert  a  GTDB  for  display  on  our  SIMNET  and  ESIG-500  IGs. 
1ST  will  be  an  evaluation  site  for  P2851  GTDBs  even  if  we  are  not  chosen  to  convert 
a  database.  The  amount  of  cooperation  between  PRC,  the  P2851  contractor,  and  1ST 
is  increasing. 


Problems: 


•  1ST  has  no  support  contract  with  BBN  for  the  SIOOO  tools.  We,  therefore,  do  not 
receive  any  software  updates.  As  of  this  writing,  our  versions  of  SIOOO  are  alre^'dy^ 
somewhat  out-of-date.  If  this  problem  remains,  1ST  will  not  be  compatible  with 
other  SIOOO  sites  (such  as  Army  ETL). 


Testing  of  articulated,  dynamic  models  is  not  possible  using  a  single  1ST  SIMNET ,  ^ 


since  we  are  at  version  6.0  of  the  real-time  software  on  the  CIG.  We  can  wor^ 
around  this  for  now,  but  this  brings  up  the  same  upgrade  question.  1ST  shoi^ld  be 
kept  current,  or  have  the  means  to  acquire  upgrades  as  needed  to  keep  our  \4ork 
relevant  to  the  services  and  industry.  \ 
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Mr.  Raymond  F.  Greene  AMCPM-TND-ET 

BAA  89-01  Monthly  Progress,  Status  and  Management  Report 
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Cost  and  Progress  Reports  for  Visual  Database 


In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress,  Status 
and  Management  Reports  and  Cost  Reports  for  Task  1  and  2  for  the  March  1991  time  period  are 
forwarded  for  your  review  and/or  approval. 
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This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report  contains 
both  task  by  current  and  cumulative  cost.  The  Progress  Reports  are  by  separate  task. 
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Monthly  Report  May  1991 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

1.  Completed  the  in  house  paper  entitled  “Automatic  Database  Generation”. 
This  paper  asks  some  general  questions  of  the  research  group  (Dr.  Mubarak 
Shah  (UCF),  Dr.  Kevin  Boyer  (USF),  Dr.  Michael  Moshell  (1ST),  Curt  Lisle 
(1ST)  and  Brian  Blau  (1ST))  about  how  computer  vision  and  database 
construction  relates.  The  ideas  of  realtime  image  processing  and  realtime 
computer  vision  are  going  to  be  important  in  the  future  of  IG  database 
issues.  The  report  is  intended  to  serve  as  a  starting  place  for  future  projects 
for  this  group.  The  report  entitled  “Automatic  Database  Generation”  is 
included  with  this  monthly  report. 

2.  The  meeting  with  Dr.  Shah  did  not  take  place  as  planned  because  of 
scheduling  conflicts.  Another  meeting  with  both  Dr.  Shah  and  Dr.  Boyer  will 
be  scheduled  soon. 

3.  Curtis  Lisle  attended  the  Project  2851  Rapidly  Reconfigurable  DataBase 
design  review  May  1-3.  Issues  discussed  included  feature  extraction  and 
geopositioning  from  Multi-Spectral  Imagery.  1ST  has  received  the  report  from 
PRC  entitled  "Multi-Source  Imagery  Investigation”  and  will  be  reviewing  it. 

Problems 

There  are  no  problems  at  this  time. 


Automatic  Database  Generation 


VSL  Document  90.14 
Date  written  :  5/3/91 
Date  printed  :  6/3/91 

Brian  Blau 

Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 
Orlando  Florida 

[Note  :  I  would  like  this  document  to  serve  as  a  prelude  to  a  meeting  during 
the  first  week  of  July.  The  entire  group  (Dr.  Mubarak  Shah  (UCF),  Dr.  Kevin 
Boyer  (USF),  Dr.  Michael  Moshell  (1ST),  Curt  Lisle  (1ST)  and  Brian  Blau 
(1ST))  should  meet  at  this  time.  I  will  make  arrangements  and  coordinate 
the  scheduling.  Please  review  this  document,  as  it  will  be  the  basis  for 
some  of  the  discussion  at  the  meeting.  Additionally,  I  would  like  this  paper 
to  be  a  start  for  discussion  about  future  projects.  This  report  is  included 
with  the  May  Monthly  report  to  PMTRADE.  ] 

1.0  Introduction 

During  the  last  year,  the  Visual  Systems  Laboratory  has  been  involved  in  the 
Rapidly  Reconfigurable  DataBase  project  which  is  funded  by  the  Army’s 
PMTRADE.  There  are  two  main  tasks  which  1ST  has  undertaken.  The 
Geospecific  Data  Center  will  function  as  an  operational  showcase  of  the 
technology  which  is  used  in  the  rapid  production  and  integration  of 
databases.  The  raw  sources  will  be  digital  geographic  data,  photographs, 
stereo  pairs,  maps,  charts  and  already  existing  database.  The  other  task 
involves  the  production  of  a  standard  simulator  database. 

It  has  become  clear  that  there  are  many  areas  of  this  project  that  the  VSL 
will  not  be  able  to  investigate  or  possibly  learn  given  our  background.  This  is 
why,  from  time  to  time,  papers  like  these  will  be  presented  to  the  sub  tasks 
for  their  comments  and  suggestions. 

In  this  paper,  the  idea  of  building  databases  from  realtime  image  processing 
will  be  discussed.  During  the  last  few  years,  the  IP  market  has  produced 
very  impressive  realtime  products  that  are  used  in  a  variety  of  applications. 
Not  only  has  the  commercial  market  seen  this  advancement,  but  it  was 
evident  that  in  the  Gulf  War,  there  were  many  uses  of  “smart  weapons” 
that  could  find  their  way  to  targets  and  destroy  them. 

The  main  question  is;  can  we  use  realtime  image  processing  to  build  image 
generator  databases,  either  totally  automatically,  or  with  human  help? 
Additionally,  how  will  this  database  correlate  with  already  existing 
databases?  This  question  is  broken  down  into  two  parts,  one  for  the  vision 
group  and  one  for  the  image  generator  database  group.  First,  is  it  feasible  to 
use  realtime  image  processing  in  the  context  of  building  databases?  Second, 


is  there  useful  information  from  image  processing  that  can  be  applied  to 
database  construction? 

2.0  Image  Processing  Capabilities 

There  are  several  questions  that  are  raised  when  talking  about  realtime 
image  processing.  First,  how  fast  is  realtime  and  what  are  the  operations 
that  can  be  performed  in  a  given  time  slice.  In  traditional  image  generator 
technology,  realtime  can  be  as  slow  as  1-3  Hz  and  as  fast  as  50-60Hz.  The 
system  guarantees  that  each  frame  will  last  no  longer  that  the  given 
amount  of  time,  and  the  image  will  be  displayed  at  the  end  of  each  clock 
tick.  The  main  question  is,  how  fast  is  fast? 

Another  area  of  concern  is  the  capabilities  of  the  realtime  image  processing 
system.  During  a  recent  SPIE  conference  exhibition  [SPIE  91  ],  there  were 
systems  demonstrated  that  could  detect  edges  and  motion  detect  at  15-30Hz 
(like  DataCube,  IntergraphC?),  Recognition  Concepts  TrapixPlus).  Does  this 
represent  the  state-of-the-art  in  realtime  image  processing? 

Additionally,  can  these  systems  be  extended?.  For  example,  can  users  add 
routines  and  functions  to  the  system  which  would  be  executing  under 
realtime  control.  Maybe  there  are  applications  which  need  additional 
functionality  which  is  beyond  the  basic  IP  system.  Can  these  functions  be 
incorporated,  and  can  these  additions  cause  the  IP  system  to  degrade  to 
non-realtime  performance. 

An  additional  question  about  an  image  processing  system.  How  closely  are 
the  image  system  (cameras)  and  the  image  processors  tied?  Are  they 
separate  functional  modules  which  can  be  interconnected  to  various  other 
IP  components,  such  as  disks  and  CPU’s?  Or  are  these  systems  mainly 
closed  with  little  or  no  hope  of  outside  integration? 

3.0  Scene  Analysis 

In  the  fields  of  computer  vision  and  image  processing,  scene  analysis  is 
incorporated  into  many  different  projects.  This  term  can  imply  complete 
analysis  of  a  particular  aspect  of  the  scene,  or  it  maybe  the  analysis  of 
motion.  In  either  case,  how  much  practical  information  can  be  obtained 
from  a  realtime  IP  system?  Data  such  as  edges,  objects,  humans  faces 
(from  Pentlands  symposium  at  UCF)  and  buildings  are  of  interest. 

4.0  Building  a  Database 

The  main  reason  we  at  VSL  are  interested  in  IP  systems  still  remains 
around  building  image  generator  databases.  Part  of  the  current  project  is  to 
investigate  technological  areas  in  both  research  and  industry  which  have 
developed  these  capabilities. 

Computer  vision  group  :  How  can  a  database  be  built  from  a  computer  vision 
or  image  processing  system?  Database  group  :  Is  there  data  that  can  be 
obtained  via  IP/CV  algorithms  which  can  be  directly  added  to  an  IG 
database?  There  are  many  different  flavors  of  IG  and  their  input  databases. 


Most  of  the  popular  IG  systems  which  are  available  to  industry  and  military 
have  specialized  software  front  ends  which  manage  their  databases. 
Currently,  there  is  an  industry  wide  effort  to  build  formatters  which  can 
take  raw  data  and  convert  it  to  any  IG  database.  There  are  additional  efforts 
to  establish  standard  database  formats  which  will  be  used  by  the  entire 
industry.  These  standard  database  will  be  used  in  the  exchange  of  data, 
protecting  the  internal  formats  of  the  specific  vendors,  but  supplying 
databases  which  can  be  sent  between  vendors.  This  capability  is  needed  for 
military  use. 

These  specialized  database  tools  can  accept  many  different  forms  of  data. 
There  are  some  that  even  perform  complex  tasks  such  as  data  correlation, 
where  raw  sources  must  be  processed  to  match  other  sources.  I  would  like 
to  know  if  there  are  places  where  information  from  IP  systems  can  be 
brought  into  these  database  tools. 

5.0  Additional  Projects 

The  following  section  is  a  proposal  for  ideas  and  projects  that  will  fit  under 
the  current  RRDB  task.  These  are  not  meant  as  specific  goals,  but  as  a 
framework  for  discussion. 

5.1  Stereo  Images 

One  of  the  possible  alternatives  for  stereo  images  are  from  synthetic 
sources.  Although  this  may  not  be  the  best  option  for  obtaining  images,  it 
certainly  is  attractive  because  many  images  of  varying  quality  can  be 
generated  quickly.  What  are  the  advantages  and  disadvantages  in  using 
synthetic  images  versus  real  images  for  the  development  of  algorithms  for 
stereo  analysis? 

This  is  a  problem  that  we  (VSL  and  UCF)  have  had  in  the  past.  Obtaining 
stereo  images  of  buildings  which  have  corresponding  ground  truth  is  not  an 
easy  task.  During  the  discussions  on  the  net’s  comp. vision  on  this 
particular  subject,  no  one  seemed  to  have  any  answers  on  if  these  image  are 
available.  I  propose  that  VSL  make  these  pictures  for  Shah.  This  can  be  done 
using  one  of  the  advanced  modeling  packages  what  are  now  located  at  VSL. 
These  scenes  are  very  realistic  and  can  be  generated  in  a  short  time.  There 
may  be  ways  to  incorporate  textures  from  real  images  in  these  synthetic 
images.  Additionally,  these  modeling  packages  can  add  fog,  haze,  clouds 
and  many  other  features  to  make  the  pictures  as  realistic  as  possible. 

Can  we  use  images  such  as  these  generated  by  modeling  packages?  Is  this 
an  alternative  to  getting  actual  pictures  of  buildings?  How  much  data 
would  be  lost  from  the  scene  analysis  when  using  these  computer  generated 
images? 

Another  possible  source  for  stereo  images  is  our  friends  in  Daytona  Beach, 

FL  at  GE.  They  have  advanced  image  generators  and  modeling  tools.  They 


should  have  already,  or  could  generate  easily,  stereo  pairs.  Is  this  worth 
investigating? 

4.2  Semi-Automated  Database  Construction 

Alternative  database  construction  tools  in  the  simulation  industry  are 
needed.  To  facilitate  the  rapid  production  goals  of  the  military  and  civilian 
governments,  database  tools  need  to  automatically  read  raw  sources  and 
produce  raw  databases  which  can  then  be  refined. 

The  following  is  a  possible  solution  for  this  problem.  This  algorithm  takes 
raw  data,  and  after  learning  about  the  data  from  some  user,  constructs  a 
database.  This  knowledge  obtained  from  the  user  can  be  used  as  a  starting 
place  for  building  additional  databases. 

The  example  shown  uses  shadow  analysis  as  the  base  processing  tool.  Each 
image  is  examined  and  a  possible  list  of  buildings  is  generated.  The  user 
selects  the  correct  buildings  and  the  processing  system  learns.  The  process 
is  repeated,  and  as  more  databases  are  built,  the  automatic  extraction  of 
buildings  will  increase  in  accuracy. 


Semi-automated  shadow  analysis 


Possible  list  of  building  and 
corresponding  shadows 

Y 

Users  chooses  correct  buildings 


Analysis  facility  learns  from  the  user 

Y 

Better  semi-automated  shadow 
analysis 


Are  these  types  of  algorithms  currently  available,  such  as  in  neural 
networks?  I  think  it  would  be  interesting  and  useful  to  start  looking  at 
some  of  this  kind  of  technology  for  possible  future  project  ideas. 


In  addition,  there  are  new  technologies  being  developed  which  are  similar  to 
image  generator  database  construction.  There  is  a  group  at  Ohio  State 
Center  for  Mapping  [Novak  91  ]  which  has  developed  an  entire  stereo 
mapping  system.  They  have  constructed  a  stereo  system  mounted  atop  a 
van.  The  image  processing  system  detects  the  road,  and  along  with  a  global 
positioning  system,  creates  a  map.  These  new  developments,  along  with 
others  need  to  be  investigated. 

5.0  Conclusion 

There  are  many  questions  that  are  raised  in  this  paper.  Many  are  basic  to 
the  understanding  to  stereo  imaging  and  processing  and  others  are 
questions  about  broad  areas  of  database  construction.  To  better  support  the 
efforts  of  IST/VSL,  these  questions  need  attention.  VSL  will  continue  to 
investigate  and  report  their  findings  on  these  topics.  All  the  members  of  the 
GeoSpecific  research  team  are  encouraged  to  do  so  as  well. 


References 

[SPIE  91  ]  SPIE  AeroSpace  Sensing  91  Photonics  Exhibition,  Marriott  World, 
Orlando,  FL.,  April  1991. 

[Novak  91  ]  Novak,  K.,  Johnson,  P.  C.,  Orvets,  G.,  “Stereo  Imaging  Meets  GIS 
for  a  Highway  Database,”  Advanced  Imaging,  vol.  6,  no.  4.,  pp  38-41,  100,  April 
1991. 


Monthly  Report:  May  1991 


Project:  Multiple  Image  Generator  Databases  (MIDB) 

Project  Lead:  Curtis  Lisle 

Accomplishments:  Several  separate  efforts  are  underway  within  the  MIDB 
project.  Highlights  of  the  past  month  are  listed  below  by  category. 

1.  SIMNET  Databases:  Several  tools  were  added  to  the  SimData  Center  toolset  this 
month.  They  are  described  briefly  here: 

SIOOO  Viewing  Tool  -  The  SI  000  model  viewing  tool  has  been  improved  since  its 
announcement  in  last  month's  report.  It  provides  quick  a  quick,  interactive 
preview  for  non-articulated  models  on  Iris  workstations. 

Model  Import  to  SIOOO  Tool  -  This  tool  takes  polygonal  databases  in  a  neutral 
format  and  converts  it  to  SIOOO  format.  The  1ST  database  developed  in 
MultiGen  has  been  converted  to  SIOOO  format.  We  hope  to  have  this  database 
visible  on  the  SIMNET  CIGs  soon. 

SIOOO  Polygon  Stretch  Tool  -  A  tool  was  written  which  "stretches"  polygons, 
causing  a  small  amount  of  overlap  between  adjacent  polygons  in  polygonal 
models.  This  is  necessary  to  overcome  shortcomings  in  the  SIMNET  CIG 
architecture. 

ITD-GRASS  Formatter  -  Ron  Klasky  has  written  converter  programs  which 
import  ITD  data  into  the  GRASS  Geographic  Information  System  vector  format. 
The  Ft  Hood  ITD  data  has  been  converted. 

2.  Project  2851:  Curt  Lisle  attended  the  Preliminary  Design  Review  for  the  RRDB 
extension  of  Project  2851  on  May  1-3,  1991.  Curt  briefed  Ray  Green  on  the  meeting 
May  14,  1991  at  PM-TRADE.  The  meeting  covered  Multi-Spectral  Imagery  and  the 
changes  to  the  SSDB  and  GTDB  designs  to  include  photo-texture.  1ST  has  received 
word  from  PRC  (the  P2851  contractor)  that  it  has  been  chosen  to  convert  and 
review  a  P2851  GTDB  during  P285rs  FSD/OT  phase. 


3.  MuItiGen  to  ESIG:  Improvements  were  made  to  the  ESIG-500  formatter  program. 
It  is  now  complete  enough  to  exercise  with  several  test  databases  over  the  coming 
months. 

4.  Ft.  Hood  Database:  1ST  has  just  received  Landsat,  NHAP  (National  High 
Altitude  Photography),  and  DIED  level  1  data  for  the  same  area.  This  will  be  used 
as  input  data  for  a  Ft.  Hood  database  1ST  will  develop. 

Problems: 
none  at  this  time 
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Dear  Mr.  Green: 
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and  Management  Reports  and  Cost  Reports  for  Task  1  and  2  for  the  April  1991  time  period  are 
forwarded  for  your  review  and/or  approval. 

If  you  have  questions,  please  contact  me  at  658-5000. 

Sincerely, 
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This  contract  is  broken  down  into  two  tasks  as  described 
below.  The  Cost  Report  contains  both  task  by  current  and 
cumulative  cost.  The  Progress  Reports  are  by  separate  task. 


TASK  1:  Rapid  Production  of  Geospecific  Databases 

TASK  2 :  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 
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May  1991 


PREPARED  BY: 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


I 


CUMULATIVE  HOURS  12608.00  4316.25  8291.75 


Interim  Status  Report  for  the 
Multiple  Image  Generator  Database  Project 


Curtis  Lisle 

1ST  Visual  Systems  Lab  (VSL) 
April  15, 1991 


Project:  BAA  #0042  -  Task  #2:  Production  of  Standard  Simulator  Databases  for 
Multiple  Image  Generators. 

Purpose:  This  dociiment  summarizes  the  work  which  has  been  accomplished 
during  the  first  year  of  this  two  year  contract  and  outlines  the  areas  where  work 
will  continue  fiuring  the  second  year  of  the  project. 

Goal  of  MIDB  Project:  The  MIDB  (Multiple  Image  Generator  Database)  project 
endeavors  to  establish  a  standard  method  of  constructing  run-time  databases  for 
multiple  low-cost  image  generators  from  a  single  set  of  input  source  data.  To 
support  this  goal,  a  suite  of  software  tools  (referred  to  collectively  as  the  SimData 
Center)  for  database  construction  is  being  created  by  1ST. 

Format  of  this  Document:  This  document  describes  the  architecture  of  the 
SimData  Center  and  lists  the  project’s  first  year  accomplishments  in  each  of 
several  major  areas. 


SimData  Center  Software 

The  SimData  Center,  when  complete,  will  be  able  to  transfer  input  source  data 
into  rim- time  databases  for  image  generators  (IGs)  from  different  vendors.  The 
basic  dataflow  of  the  center  is  shown  in  Figure  1. 

Input  Process:  Several  standard  data  input  formats  will  be  supported,  including 
DMA  DTED,  DFAD,  and  Project  2851  GTDB.  Each  different  source  format  will  be 
converted  by  a  Formatter  Program  (FP)  and  converted  into  a  Flight  format 
database  (a  pubhc-domain  polygonal  data  format  created  by  Software  Systems). 

Software  System’s  MultiGen  package  will  be  used  to  correlate,  register,  and 
combine  the  data  from  each  input  format  once  it  has  been  converted  to  Flight 
since  MultiGen  is  a  complete  development  environment  which  operates  on  the 
Flight  format. 

Compiling  for  Run-Time:  Once  a  completed  database  exists  in  Flight  format,  it 
will  be  compiled  by  separate  sets  of  software  to  produce  run-time  databases  for 
different  IGs.  Figure  1  shows  the  first  two  paths  planned  which  support  the  BBN 
Delta  Graphics  SIMNET  IG  and  the  Evans  &  Sutherland  ESIG-500  IG. 

In  each  case,  the  compilation  is  performed  by  writing  a  formatter  program  which 
converts  a  database  from  Flight  format  to  a  format  suitable  for  input  into  the 
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vendor-supplied  tools.  Vendor-supplied  tools  are  used  because  the  run-time 
format  for  each  IG  is  usually  proprietary  and  is  optimized  for  performance  of  that 
particular  system.  It  is  more  efficient  for  ISTA/'SL  to  avoid  the  machine- 
dependent  nm-time  formats. 


Figure  1  -  SimData  Center  Dataflow 

Toolset  List:  The  following  list  shows  some  of  the  tools  planned  for  inclusion  in 
the  SimData  Center  at  the  end  of  the  second  year  of  the  project: 


•  MultiGen  to  ESIG  Formatter;  Take  a  Flight  format  database  and  convert 
it  for  input  into  the  E&S  compiler. 

•  MultiGen  to  SIOOO  Formatter:  Take  a  Flight  format  database  and  convert 
it  for  input  into  the  BBN  SIOOO  compiler. 

•  SIOOO  Model  Display:  Display  a  polygonal  model  in  SIOOO  format  on  the 
IRIS  workstation.  This  is  a  productivity  enhancement  since  models  are 
currently  viewable  only  on  the  SIMNET  CIG. 

•  Model  Import;  Take  polygonal  models  in  a  variety  of  formats  and  convert 
them  into  Flight  for  use  in  visual  databases. 
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•  ITD  Import:  ITD  data  will  be  read,  converted  to  Flight ,  and  used  to 
provide  culture  and  network  features  in  visual  databases. 


Accomplishments 

Progress  has  been  made  during  the  first  year  on  all  parts  of  the  dataflow  in 
Figure  1.  The  progress  is  summarized  into  several  categories  below: 

SEMNET  Databases:  VSL  has  acquired  and  installed  the  SlOOO  tools  for  SIMNET 
database  creation.  At  the  time  of  this  writing,  VSL  and  Army  ETL  are  the  only 
labs  outside  of  BBN  with  SIMNET  database  creation  capability.  Curt  Lisle  and 
Jacki  Morie  were  trained  on  the  SlOOO  tools  by  a  BBN  modeler  in  residence  at 
Army  ETL. 

We  familiarized  ourselves  with  the  SlOOO  environment  by  creating  a 
demonstration  database  using  the  Indian  Springs,  NV  DMA  DTED  and  placing 
Ciiltural  features  by  hand.  After  creating  this  assembly  (BBN’s  term  for  a 
complete  but  uncompiled  database),  we  successfully  compiled  it  and  transferred 
the  database  to  the  SIMNET  CIGs.  The  compiled  database  was  viewed  with  the 
stealth  simulator  for  visual  verification.  Terrain  following  and  collision  detection 
were  verified  by  driving  on  the  database  with  the  Ml  simulator. 

After  being  satisfied  that  we  imderstood  the  correct  process  for  static  terrain 
creation,  a  multiple  level  of  detail,  articulated  vehicle  was  created,  placed  on  the 
SIMNET  and  tested.  This  new  icon  of  the  NLOS  HMMWV  vehicle  is  in  use  by 
PRC  at  the  Ft.  Rucker  SIMNET  site.  This  process  involved  more  learning  of  the 
SIMNET  architecture  than  was  anticipated. 

Evans  &  Sutherland  Databases:  We  have  nearly  completed  the  formatter  between 
Flight  format  and  the  ESIG  tools.  This  formatter  has  been  tested  by  using  it  to 
convert  several  polygonal  models  and  a  database  of  the  Research  Pavilion  and 
NTSC  buildings  in  Research  Park.  We  demonstrated  this  capability  to  PM- 
TRADE  during  the  January  1991  review. 

Polygon  priority  was  an  issue  which  had  to  be  solved  during  the  development  of 
the  Flight  to  ESIG  formatter.  The  ESIG  requires  separation  planes  in  its  run¬ 
time  database  for  correct  viewing.  Separation  planes  are  created  as  a  post¬ 
processing  operation  between  MultiGen  and  the  ESIG  tools.  We  initially  used 
semi-automatic  routines  provided  by  Software  Systems  for  developing  separating 
planes,  the  Software  System’s  routines  may  be  replaced  by  VSL-developed 
software  during  the  project’s  second  year.  Further  work  is  still  needed  here,  but 
we  have  successfully  generated  separating  planes  in  the  Research  Park  database. 

Project  2851:  VSL  is  tracking  the  progress  of  the  Air  Force  Project  2851  (P2851) 
since  the  MIDB  project  goal  of  developing  a  database  development  environment 
must  be  relevant  to  future  P2851  databases  as  well  as  existing  IG  databases  and 
technology. 
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Curt  Lisle  attended  and  presented  briefly  at  the  I/SWG  in  January  1991  at  PRC, 
McLean,  VA.  The  GTDB  prototype  production  facility  is  almost  complete  and  will 
be  producing  a  number  of  GTDBs  over  the  next  eighteen  months.  VSL  has  been 
selected  as  an  evaluation  sight  for  run-time  databases  made  from  GTDBs. 

VSL  has  proposed  to  PRC  (the  P2851  contractor)  that  VSL  be  selected  to  actually 
convert  a  single  GTDB  into  run-time  databases  for  the  SIMNET  and  ESIG-500.  If 
we  are  selected,  the  database  would  serve  as  a  complete  test  case  for  the  SimData 
Center  software  suite. 


MIDB  Focus  for  the  Second  Year 

The  SimData  Center  software  will  be  exercised  during  the  second  year  of  the 
project  as  each  prototype  formatter  is  completed.  We  will  demonstrate  the  system 
by  using  it  to  develop  and  convert  a  database  for  display  using  at  least  the  BBN 
SIMNET  and  the  E&S  ESIG-500. 

SIMNET  Databases:  VSL  will  focus  on  developing  the  formatter  between  Flight 
and  BBN’s  SIOOO  environment  during  the  second  year  of  this  project.  We  have 
already  begun  stud3dng  the  intermediate  formats  created  during  the  several  step 
development  process  used  by  the  SIOOO  tools.  Once  formatter  prototypes  are 
completed,  they  will  be  tested  using  MultiGen  terrain  databases  and  polygonal 
models. 

ESIG  Databases:  With  the  ESIG  formatter  nearly  complete,  we  can  begin 
exercising  this  interface  with  a  variety  of  databases  to  determine  the  best  design 
methodologies  when  constructing  databases  for  viewing  on  the  ESIG.  The  second 
year  may  include  phototexture  application  to  ESIG  terrain  if  we  acquire 
appropriate  imagery  from  P2851  or  other  sources. 

Project  2851:  If  PRC  grants  our  proposal,  we  will  be  converting  a  GTDB  for 
display  on  our  IGs  using  the  SimData  Center  software.  This  effort  would  convert 
a  complete  database  involving  terrain,  culture,  and  moving  models  and  provide  a 
complete  system  test  (from  input  to  display  on  both  IGs). 
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Monthly  Report  June  1991 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Accomplishments 

1.  Brian  Blau  has  been  in  Contact  with  Pedro  Ramos  of  General  Electric  in 
Daytona  Beach  about  obtaining  images  of  Indian  Springs  AFB  in  Nevada. 
Pedro  indicated  that  GE  would  possibly  be  able  to  provide  1ST  with  these 
images  along  with  other  images  that  they  have  used  in  the  Rapidly 
Reconfigurable  Database  Project.  These  images  would  be  used  as  test  cases 
for  the  software  being  developed  for  this  project. 

2.  A  meeting  of  the  research  group,  which  consists  of  Dr.  Mubarak  Shah  of 
UCF’s  Computer  Science  Department  and  Dr.  Kevin  Bouyer  of  USF’s 
Computer  Science  Department  will  be  held  during  the  first  half  of  July.  At 
this  meeting  we  will  discuss  the  timeline  for  the  remaining  6  months  of  the 
project  and  ideas  for  follow  on  work. 

3.  Brian  Blau  has  completed  a  timeline  for  the  remainder  of  the  project.  It  is 
included  with  this  report. 

Problems 

There  are  no  problems  at  this  time. 


Monthly  Report:  June  1991 


Project:  Multiple  Image  Generator  Databases  (MIDB) 

Project  Lead:  Curtis  Lisle 

Accomplishments:  Several  separate  efforts  are  underway  within  the  MIDB 
project.  Highlights  of  the  past  month  are  listed  below  by  category. 

1.  SIMNET  Databases:  The  SI 000  Model  Viewing  tool  has  been  completed.  It 
allows  interactive  viewing  of  models  using  the  IRIS's  mouse  to  position  the  camera 
and  zoom  in  or  out  The  Research  Park  database  was  successfully  ported  to  the 
SIMNET  system.  It  was  evaluated  by  driving  the  MI  tank  on  the  database.  We  are 
now  studying  the  terrain  and  USO  (roads,  rivers,  treelines,  canopies)  data  formats 
in  order  to  import  this  data  into  SI 000. 

2.  Project  2851 :  A  revised  technical  and  cost  proposal  was  sent  to  PRC  for  our 
subcontract  work  involving  the  conversion  of  GTDB  data  for  our  IGs  at  1ST.  We  will 
begin  development  of  this  conversion  software  during  the  month  of  July. 

3.  NOSC:  Curt  Lisle  met  with  Kevin  Boner  of  the  Naval  Ocean  Systems  Center. 
NOSC  is  interfacing  an  unmanned  air  vehicle  simulator  to  the  SIMNET  network. 
1ST  provided  information  about  the  SIMNET  database  formats  to  help  them  get 
database  compatibility.  The  NOSC  effort  will  be  the  second  (after  PRC,  Rockledge 
with  the  NLOS  project)  to  interface  an  outside  simulator  to  the  SIMNET  network. 
1ST  has  provided  technical  assistance  to  both  of  these  groups. 

4.  Attached  Report:  Per  the  request  of  our  COTR,  a  summary  status  report  for  the 
MIDB  project  is  included. 

Problems: 

none  at  this  time 
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In  accordance  with  the  requirements  of  the  above  referenced 
contract,  the  Monthly  Progress,  Status  and  Management  Reports  and 
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Overall  Activities 

The  activities  of  this  project  can  be  described  in  four  broad  areas:  the 
acquisition  of  skilled  personnel  in  key  technical  areas  to  support  the 
Geospecific  Data  Processing  Center  (GeoData  Center):  the  acquisition  of 
hardware  and  software  to  support  the  complex  activities  in  rapid  production 
of  databases;  automatic  production  of  terrain  databases  and  technology 
transfers  to  industry. 

Skilled  Personnel.  The  Visual  Systems  Laboratory  (VSL),  in  support  of  the 
Geospecific  Data  Processing  Center  has  staffed  itself  with  highly  qualified 
personnel  which  are  trained  in  the  speciality  areas  of  computer  graphics, 
computer  vision  and  image  processing.  Dr.  Michael  Moshell,  who  leads  VSL 
has  20  years  experience  in  the  computer  and  physical  sciences.  Brian  Blau, 
Curt  Lisle  and  Ron  Klasky  have  their  Masters  of  Science  in  Computer 
science  and  each  has  experience  in  computer  graphics.  Klasky  has 
additional  experience  in  image  processing  and  astronomy  and  Lisle  has 
additional  experience  in  low-level  design  of  computer  image  generators. 

The  quality  of  the  personnel  listed  above  is  enhanced  by  a  pool  of  students 
from  the  Computer  Science  Department  at  the  University  of  Central  Florida. 
This  department  has  a  nationally  recognized  program  with  excellence  in 
parallel  computation  and  VLSI  design.  Most  recently,  their  student 
computer  programming  team  placed  fifth  in  an  internationally  recognized 
programming  contest  One  of  the  programing  team  members  is  now 
employed  at  VSL. 

Hardware  and  Software  at  the  GeoData  Center.  Over  the  past  year,  the 
VSL  has  acquired  software  and  hardware  necessary  to  support  the  complex 
tasks  involved  in  the  production  of  databases.  The  following  list 
summarizes  the  capabilities  of  the  GeoData  Center  : 

Image  Generators 

These  machines  have  the  capability  to  display  geographic 
databases  in  three  dimensions  at  real-time  update  rates. 


VSL  has  the  ESIG  500  as  its  highest  powered  rendering  engine. 
Databases  from  multiple  sources  can  be  built  on  support 
machines  and  then  downloaded  to  the  ESIG  for  display. 
Additionally,  SIMNET’s  Image  Generator  from  Delta  Graphics 
is  available  for  viewing  more  customized  models  and  databases 

The  Silicon  Graphics  Power  Series  is  a  new  addition  to  VSL 
which  will  enhance  the  capability  to  rapidly  see  low  fidelity 
simulations.  This  is  an  excellent  platform  for  visualization  of 
low  detail  and  low  band  width  databases.  Because  this 
platform  is  a  workstation,  it  is  easily  reconfigurable  and  will 
host  many  different  software  systems. 

Image  Processing  Software 

The  GRASS  image  processing  system,  in  conjunction  with  the 
KUTRTA  digitizing  tables,  is  being  used  to  generate  IG 
databases.  Sources  include  DMA  DTED/DFAD,  satellite  images 
and  maps.  These  sources  are  combined  in  GRASS  and  written 
to  a  script  file  for  use  in  the  ANIM  object  animation  system. 
Additional  routines  exist  for  exporting  this  data  to  the 
Multigen  system,  which  is  a  tool  for  building  image  generator 
databases. 

Modeling  Software 

The  software  packages  ElectroGig,  AutoSolid,  Alias,  SI 000  and 
Geometric  Modeling  System  are  useful  when  building 
custom  image  generator  database  models.  Specifically,  SI  000 
and  Multigen  has  been  used  to  build  models  for  various 
industrial  partners  and  projects  tasks.  These  packages  give  the 
GeoData  Center  an  ability  to  quickly  build  databases  to 
customer  specifications.  These  databases  can  then  be 
transformed  into  the  appropriate  formats  to  be  displayed. 

Additional  Software  and  Hardware 

The  VSL  has  two  Sun  Sparc  workstations  for  use  in  the  GeoData 
Center.  These  machines  are  general  purpose  UNIX  computers 
that  run  at  very  high  clock  speed.  This  gives  the  GeoData 
Center  the  ability  to  perform  complex  tasks  required  for 
database  construction. 

Additionally,  VSL  has  the  ability  to  read  and  display  DMA 
DTED/DFAD  databases.  Many  of  the  software  packages 
mentioned  above  have  this  feature  which  gives  the  GeoData 
Center  additional  capabilities  to  build  geospecific  databases. 

Automation  of  Terrain  Database  Production.  One  of  the  main  goals  of 
this  project  is  to  determine  unique  and  efficient  methods  for  automatic  and 
semi-automatic  constructions  of  databases  for  image  generators  in  support 
of  some  standard  database  interchange  format  The  GeoData  Center  has 


the  capability  to  build  databases  in  several  formats  and  continues  to  add 
flexibility  to  this  process. 

Using  the  Multigen  and  GRASS  systems  mentioned  above,  the  GeoData 
Center  can  take  raw  input  data,  such  as  DMA  DTED/DFAD,  remote  sensing, 
maps  and  photos  and  create  individual  databases  which  are  at  first  specific 
to  the  hardware  and  software  platform.  Additional  support  comes  from 
human  modelers,  which  is  now  the  only  way  to  actually  integrate  all  of  the 
data.  In  the  future,  the  integration  of  the  databases  will  be  automated  by 
the  use  of  intelligent  software  which  will  analyze  the  attributes  of  the  data 
and  then  determine  how  the  end  databases  need  to  be  combined  to  form  the 
standard  database. 

Additionally,  VSL  has  developed  a  series  of  software  packages  which  can 
extract  useful  3D  information  from  images.  One  package  can  recover  depth 
from  stereo  images  and  the  other  package  can  recover  building  information 
from  shadows.  Both  of  these  packages  have  been  documented  in  the 
monthly  reports  for  this  project 

Technology  Transfer 

GeoData  Center  Technology  Transfer:  The  GeoData  Center,  when  complete 
at  the  end  of  the  second  year  of  this  project,  will  be  a  toolset  which  creates 
computer  representations  of  regions  of  geospecific  terrain.  Digitized  terrain 
technology  is  attractive  to  a  variety  of  industrial  companies  and 
government  organizations.  VSL  has  already  begun  relationships  which  will 
make  this  technology  available  to  them. 

VSL  is  beginning  a  relationship  with  the  Army  Engineer  Topographic  Lab 
where  we  will  be  cooperating  with  them  in  the  development  of  geospecific 
database  technology  for  simulators.  VSL  has  already  been  funded  by  Martin 
Marietta  to  produce  software  prototypes  which  realistically  display, 
geospecific  terrain  in  a  simulator  using  Continuous  Levels  of  Detail  to 
minimize  the  number  of  polygons  needed  while  preserving  terrain  features 
like  ridge  lines,  contours,  etc.  VSL  will  be  serving  as  a  demonstration  site  for 
Project  2851  standardized  databases  as  they  become  available  over  the  next 
eighteen  months  -  providing  the  simulator  industry  with  an  independent 
organization  with  expertise  in  this  future  database  format.  Project  2851 
format  databases  are  required  for  all  new  military  training  contracts 
involving  Computer  Image  Generators. 

As  this  project  progresses,  VSL  will  continue  to  look  for  avenues  to  make  this 
technology  available  to  interested  organizations. 
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Overview.  During  the  first  year  of  the  project,  there  were  two  significant 
software  developments  which  has  lead  the  Visual  Systems  Laboratory  (VSL) 
to  build  a  standard  database.  These  two  software  packages  were  built  by  Dr. 
M.  Shah  and  Dr.  K.  Boyer  of  UCF  and  USF  respectively. 

Stereo  and  Shadow  Analysis.  Dr.  Shah  and  his  students  have  built  a 
software  system  which  when  given  a  stereo  pair,  can  determine  the  depth  of 
the  scene.  Additionally,  Dr.  Boyer  and  his  students  have  built  a  software 
system  which  when  given  an  image  of  buildings  and  shadows  can 
determine  the  height  of  those  buildings.  Both  of  these  software  packages 
have  been  documented  in  the  monthly  reports  for  this  project 

Demonstration.  This  software  will  be  used,  along  with  commercial 
packages  like  Multigen  and  SI 000  to  build  the  sample  database.  On  January 
25  1991,  VSL  presented  a  demonstration  of  the  capabilities  which  were 
developed  during  the  first  year  of  the  project  Using  both  commercial 
software  and  applications  developed  for  this  project  the  data  flow  from  raw 
images  to  image  generator  database  was  shown. 

During  the  second  year,  an  additional  databases  will  be  built  according  to 
the  guidelines  proposed  in  this  project 
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Overall  Activities.  The  Visual  Systems  Laboratory,  in  support  of  the 
Geospecific  Data  Processing  Center  (GeoData  Center),  is  developing  an 
integration  manager  system  which  will  direct  the  activities  of  several 
specialized  software  and  hardware  packages  to  produce  standard  databases. 

Integration  Manager.  This  system  includes  a  master  planning  unit 
which  helps  to  direct  the  overall  flow  of  the  data  through  the  system.  It  can 
recognize  different  types  of  raw  inputs  (i.e.:  DMA  DTED/DFAD,  images, 
photos),  looks  at  their  attributes  and  where  they  are  located,  and 
automatically  determines  their  part  in  the  building  of  the  final  database. 

In  the  course  of  building  the  database,  there  may  be  decisions  that  require 
the  intervention  of  the  human  operator.  At  this  point,  the  software 
manager  will  ask  the  operator  specific  questions  about  the  configuration  of 
the  data  as  well  as  any  ambiguities  that  may  arise. 

The  decisions  from  the  operator  will  be  interpreted  by  the  integration 
manager  and  the  analysis  of  the  data  will  continue.  This  interactive 
process  will  continue  until  the  final  goal  of  complete  database  is  met 
When  the  database  is  finished,  it  will  be  in  the  standard  format  selected 
prior  to  the  start  of  the  analysis. 

Work  to  Date.  The  working  aspects  of  this  part  of  the  project  can  be  found 
in  the  various  sections  of  the  GeoData  Center.  During  the  calendar  year 
1991,  many  aspects  of  the  integration  manager  will  be  incorporated  together 
to  make  a  semi-automatic  system. 

One  of  the  main  components  that  has  been  developed  independently  of  this 
project  is  VSL’s  work  in  Virtual  Reality.  Their  latest  software  development 
is  Virtual  Environment  Realtime  Network  (VERN).  This  application  gives 
its  users  the  ability  to  communicate  across  heterogeneous  platforms.  This 
ability  which  will  be  included  in  the  GeoData  Center  will  add  a  level  of 
flexibility  that  would  not  normally  be  part  of  a  project  such  as  this. 
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Introduction 

This  document  will  describe  the  first  year’s  work  in  support  of  Task 
#1,  Rapid  Production  of  Geospecific  Databases  of  the  Visual  Database 
Research  and  Development  project  at  1ST  which  is  funded  by  PM-TRADE. 

The  primary  goal  of  this  project  is  to  provide  a  way  to  increase  the 
productivity  of  human  database  modelers,  especially  those  working  with 
low-cost  image  generators.  Accomplishing  this  goal  involves  the 
introduction  of  several  new  technologies  which  are  usually  not  associated 
with  simulator  database  construction.  These  technologies  include 
Geographical  Information  Systems  (GIS)  and  computer  vision.  These  new 
technologies  will  be  used  to  support  the  Geospecific  Data  Processing  Center, 
an  organization  within  1ST  which  will  include  skilled  personnel,  software 
and  hardware  necessary  for  the  rapid  integration  of  digital  geographic  data, 
photographs,  including  stereo  pairs,  maps  and  charts. 

Over  the  past  year,  there  have  been  a  number  of  specific  sub-projects 
that  were  designed  to  get  a  better  understanding  of  the  simulator 
construction  process.  This  included  analysis  of  off-the-shelf  software  and 
hardware  that  already  has  taken  this  technology  to  the  forefront.  , 
Implementations  of  stereo  processing  and  shadow  analysis  helped  in  the 
evaluation  of  the  main  goal  of  this  project.  Additionally,  there  were 
consultations  with  industry  officials  who  have  insight  into  this  arena  of 
work.  Their  help  along  with  the  work  done  by  Dr.  Mubarak  Shah  at  the 
University  of  Central  Florida  and  Dr.  Kevin  Boyer  at  the  University  of  South 
Florida  has  contributed  to  the  success  1ST  understanding  of  the  simulator 
construction  process. 

Accomplishments 

During  the  past  year,  there  have  been  many  aspects  of  this  project 
which  have  contributed  to  the  GeoData  Center  and  each  will  be  described 
individually.  The  cumulative  effect  of  these  efforts  is  also  an  important 
aspect  which  needs  to  be  recognized. 

During  the  first  six  months  of  this  project,  there  was  a  concentrated 
effort  to  define  the  overall  scope  of  this  project,  as  well  as  define  important 
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goals  for  the  coming  year.  The  following  is  a  list  of  accomplishments  which 
took  place  during  the  first  year  : 

•  SIMNET  Database  :  Programs  were  written  to  read  the  SIMNET 
database.  This  is  the  plan  view  database  which  is  located  on 
the  Mascomp  computer.  This  effort  was  very  successful,  the 
data  gathered  from  this  experiment  was  valuable  in  many 
different  aspects  of  this  project  The  code  written  was  also 
used  in  other  spin-off  projects  (Virtual  Reality  Demo  @  I/ITSC 
90,  VSL’s  bulldozer  and  car  on  SIMNET  terrain  demo,  Blau’s 
masters  thesis). 

Demonstrations  of  bulldozer  on  SIMNET  terrain  done  at  VSL 
during  first  quarter.  1991,  used  dynamic  and  microterrain 
techniques  developed  at  VSL.  Demonstration  of  another 
derivative  of  SIMENT  software  done  at  I/ITSC  90  in  fourth 
quarter  1991. 

Problems  in  this  area  came  about  because  VSL  was  unable  to 
have  access  to  the  SIMNET  CIG  database.  Dynamic  terrain  was 
to  be  put  on  SIMNET,  but  because  of  restricted  access  to  the  CIG 
database,  work  stopped  in  this  area. 

•  Univ.  of  Waterloo  :  An  image  processing  tool  kit  was  acquired 
at  nominal  cost.  Uses  include  general  image  processing 
functions  and  display  functions.  Documentation  and  source 
code  is  available. 

•  Stereo  Extraction  :  Dr.  Mubarak  Shah  and  graduate  students 
from  the  Computer  Science  department  of  the  University  of 
Central  Florida  started  work  on  extracting  image  depth  from 
stereo  images.  He  specifically  concentrated  on  using  off-the- 
shelf  algorithms  as  a  working  introduction  to  this  field.  Plans 
for  the  year  include  implementation  of  several  known 
extraction  algorithms,  analysis  of  these  algorithms  to 
determine  the  focus  of  the  second  years  effort. 

•  Shadow  Extraction  :  Dr.  Kevin  Boyer  and  graduate  students 
from  the  Computer  Science  department  of  the  University  of 
South  Florida  started  work  on  extracting  building  height  from 
shadows.  Buildings  cast  shadows  in  an  image,  and  through 
some  geometry  and  computer  vision  techniques,  the  building 
height  can  be  calculated.  He  specifically  started  to  look  at 
current  algorithms  to  accomplish  this  goal.  Plans  for  the  year 
include  implementation  of  several  algorithms  and  analysis  of 
these  algorithms  to  determine  the  focus  of  the  second  years 
effort 
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•  Literature  Review  :  Annotated  bibliographies  were  constructed 
in  the  areas  of  stereo  extraction  and  shadows  analysis.  These 
documents  were  submitted  with  the  Quarterly  report  in  June 
1991. 

•  Industrial  Contacts  and  Logistics  :  Information  was  gathered 
from  the  following  sources:  DMA  data  and  the  hardware 
necessary  to  read  tapes,  David  McKeown  at  Carnegie  Mellon  for 
information  about  shadow  extraction  and  images 

The  work  done  in  the  first  six  months  defined  clear  goals  that  meet 
the  expectations  of  this  project.  Specifically,  the  process  of  taking  multiple 
inputs  (ie:  digital  geographic  data,  single  photographs,  stereo  images,  maps, 
charts)  can  be  integrated  together  for  form  accurate  simulator  terrain 
databases. 
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Figure  1.  Path  from  raw  data  to  flyable  database 

During  the  last  six  months  of  the  first  year  of  the  project,  efforts 
continued  in  the  areas  described  above.  The  implementation  was 
completed  for  the  stereo  extraction  and  shadow  extraction  algorithms. 
Additionally,  industrial  contacts  were  made  during  this  period.  The 
following  is  a  specific  list  of  work  accomplished  during  the  last  half  of  the 
first  year  : 

•  Stereo  Extraction  :  Dr,  Shah  and  his  students  implemented 
three  separate  stereo  extraction  techniques.  The  output  from 
all  three  is  an  image  of  depth  values,  where  at  an  (x,  y)  location 
there  is  a  corresponding  depth.  The  problem  here  is  that  the  (x, 
y)  values  are  image  coordinated,  not  actual  physical  values. 
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Normalized  correlation  method  by  Cochran  and  Medioni 
matches  a  point  in  the  left  image  and  right  images  and 
computes  the  disparity,  which  is  then  translated  into  height. 

Sum  of  absolute  difference  method  by  Kayalap  uses  the 
difference  of  the  correlation  of  points  in  the  left  and  right 
images  to  compute  the  disparity.  Again  depth  can  be  obtained 
from  disparity. 

Prazdny’s  method  computes  the  correlation  only  at  edge  points 
in  the  image  and  it  is  based  on  a  smoothness  criterion.  The 
disparity  is  computed  at  the  edge  points  and  then  translated  to 
depth  values. 

•  Shadow  Analysis  :  Dr.  Kevin  Boyer  and  his  students  have 
completed  implementation  of  an  interactive  software  package 
which  lets  the  user  choose  a  building  to  analyze.  First  the  user 
is  presented  with  an  image  which  contains  buildings,  they  are 
then  instructed  to  trace  a  building  and  then  its  shadow.  The 
height  of  the  building  is  then  computed  and  stored  in  a 
database  file. 

•  CAD  Package  for  use  with  Stereo  algorithms  :  Chuck 
Campbell  and  Brian  Blau  have  developed  an  interactive  CAD 
style  software  package  to  interpret  the  output  from  Shah’s 
algorithms.  This  software  provides  a  view  of  the  depth  fields  as 
a  grid  of  posts,  where  the  height  of  the  posts  correspond  to  the 
disparity  between  the  left  and  right  images.  The  user  is  then 
able  to  construct  polygons  using  the  tops  and  bottoms  of  the 
posts.  The  output  of  this  program  is  a  database  of  polygons. 

•  Animated  Fly  Through  ;  The  output  from  the  interactive  CAD 
software  and  the  shadow  extraction  are  inputs  to  Curt  Lisle’s 
ANIM  Object  Animation  package.  This  software  can  be  viewed 
as  a  generic  object  rendering  engine.  It  is  used  to  fly  through 
the  data  that  was  created  by  both  the  stereo  extraction  and 
shadow  analysis. 

The  stereo  depth  extraction,  shadow  analysis,  CAD  interactive 
software  and  animated  fly  through  were  documented  and 
demonstrated  for  the  sponsors  in  January  1991. 

•  Industrial  Contacts  and  Logistics  :  There  has  been  contact 
with  General  Electric  about  their  TARGET  database 
construction  toolkit.  At  the  present  time,  1ST  is  attempting  to 
establish  a  working  relationship  which  will  benefit  both 
organizations. 
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Images  in  both  digital  and  picture  form  are  being  collected  by 
VSL  to  support  the  GeoData  Center.  Along  with  this,  continued 
research  is  being  done  in  the  areas  of  cartography  and  satellite 
imaging. 

The  following  is  a  diagram  of  how  the  different  aspects  of  database 
production  fit  together.  It  shows  how  stereo  extraction  combined  with 
shadow  analysis  are  combined  through  software  and  human  interaction 
into  a  simulator  database. 
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Figure  2.  Stereo  analysis,  shadow  analysis  and  database  flythrough 
Conclusions 

After  the  first  year  of  concentrating  efforts  on  the  rapid  production  of 
simulator  databases,  it  has  become  apparent  that  there  are  many 
formidable  tasks  which  lie  ahead.  There  are  issues  that  both  Shah  and 
Boyer  will  be  addressing  in  the  second  year  that  will  help  solve  some  of  the 
problems  encountered  while  conducting  the  stereo  and  shadow  research. 
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Create  demonstration  database  •  Start  Sept.  16,  1991 


Visual  Systems  Laboratory 
Visual  Database  Development  Process: 


DFAD,  CAD  tools,  modeling,  ITD,  Imagety,  Maps 
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Visual  Systems  Laboratory 
SimData  Center  Example  Datapaths: 
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Visual  Systems  Laboratory 
Geospecific  Database  Generation: 
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omplete  software  development  and  •  On  schedule 

produce  a  final  demonstration  database 


Visual  Systems  Laboratory 
Geospecific  Database  Generation: 
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complex  extracted  from  photographs 
(demonstrate  automatic  extraction). 

Jan.  '92  ■■  Feb.  '92:  •  Evaluate  databases  &  prepare  final  report. 


Visual  Databases:  The  1ST  Difference 
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-  SIMNET  Development  site  at  UCF 

-  Curt  Lisle's  architecture  design  with  GE 

-  Industrial  Connections: 

Evans  &  Sutherland,  GE,  Software  Systems 


MAJOR  TECHNOLOGIES  PAYOFFS  RISKS 
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Four  Dynamic  Terrain  Features 


•  Earthworks 

(Emplacements,  tank  traps,  drainage,  fords) 

The  Need:  Hull  Defilade! 

The  key  problems:  variable  shape,  lots  of  polys 

•  Craters 

(Bomb  and  Artillaiy  impact,  mines) 

The  Need:  Improved  fidelity  '' 

The  key  problem:  LOTS  of  craters! 

•  Track  Marks 

(Armor  Tread  damage  to  soil  &  vegetation) 

The  Need:  Evidence  of  enemy  travel 

The  key  problem:  LOTS  of  polygons,  overlaid. 

•  Hydrology 

(Rain  accumulating  in  low  places,  forming  streams) 

The  Need:  Critical  effect  ofprecip  on  trafficability 
The  key  problem:  Updating  the  whole  terrain  at  once. 
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Feasibility  of  Tactical  Dynamic  Terrain 

•  SIMNET  I:  300  polys  for  terrain,  400  culture,  300  models 

•  20  degree  FOV  x  3.5  km  = 

8.9  load  modules  (LM)  x  (<32  polys)  = 
up  to  285  polygons  in  view. 


16  X 16  LM 

Let  s  imagine  SIMNET  11  - 

•  600  polys  for  terrain  (300  static,  300  DT) 


One  LM=.5km^ 
^32  polygons 


Now,  HOW  MANY 

•  Emplacements 

•  Craters 
•Track  marks 

Could  we  reHabiy  display? 
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Feasibility  of  Tactical  Dynamic  Terrain 


Track  Marks 

Case  1:  Straight  line  travel 

=  Two  polys  per  flat  surface. 


Each  LM  traversed  would  generate 
8  to  24  new  polys,  for  track  marks. 


Case  2:  One  maneuver  every  5  tank  lengths  (40m) 


=  (about)  12-15  maneuvers  per  0.5  km  (one  LM) 
of  which  about  half  would  cross  poly  bounds, 

f - - - ^ 

=  18  to  22  ('^2)  =  36  to  44  polygons  per  LM 

traversed.  - - - - 
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Feasibility  of  Tactical  Dynamic  Terrain 


EmDlacements 


•  Cheap:  9  polys 

•  Nice:  25  polys 


Perspective  View 


Top  View 


Craters 


REAL  cheap:  11  polys 
Cheap  (square):  13  polys 
Nice:  48  polys 
(Irregular  hexagon) 
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Feasibility  of  Tactical  Dynamic  Terrain 


Levels  of  Detail: 

•  A  2m  high  crater  (or  earth  berm)  at  1  km  range  subtends 
0.11  degrees. 

—  -  1 


SIMNET  s  vertical  FOV  is  about  7.5  degrees,  128  lines 
-  so  one  pixel  is  0.058  degrees  high. 


7.5  degrees/128  lines 


•  Thus,  the  2m  berm  is  two  pixels  high  at  1  KM  range. 


•  If  one  simply  OMITS  all  DT  features  at  >  1  KM  range, 
this  reveals  at  most  2  pixels  of  whatever  s  hiding  behind 
them. 


-  which  should  be  standing  in  a  hole,  too...  and  will 
automatically  be  "partially  buried"  by  the 
depth  buffer,  in  the  planar  poly  in  coarse  LOD. 
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Feasibility  of  Tactical  Dynamic  Terrain 


Maximum  Feature  Densities  with  600  polygons  for  Terrain 
(300  for  Dynamic  Terrain  AND  1  km  LOP  ControD! 


Polys  per 
Feature 

Max.  Nr. 
inFOV 

Safe 
Density 
per  KM 

Emplacement  -  Cheap 

9 

33 

183 

Emplacement  -  Nice 

25 

12 

66 

Crater  -  Cheap 

13 

23 

126 

Crater  -  Nice 

48 

6 

34 

Track  Marks  -  Straight 

48/km 

6KM 

34 

Track  Marks  -  Maneuvering 

80/km 

4  KM 

20.6 

.363  km  Area 

=  .18  sq  km 

1  km 

And 


•  You  can  STILL  "pick  any  three  items"  if  were  using  1000 
polygons  for  DT  features. 
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Dynamic  Terrain 
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Dynamic  Terrain 
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Project  Status  Summary  -  Dynamic  Terrain 
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1  Dec.  91  -  Experiments  Complete 
1  Jan.  92  -  Draft  Report 
15  Feb.  92  -  Final  Report 
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Real-world  Customers  and  Needs 
-  Combat  Engineers 
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Head-Tracking  and  Head-Mounte 
Display  Technology 
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Figure  1.  Head  Tracking  Display 


HEAD-TRACKED  CUPOLA  DISPLAY  EVALUATION 

Experimental  Design 

TASK 


TERRAIN  REASONING 

TARGET  ACQUISITION 

EQUIPMENT 

Cl 

C2 

HEAD-TRACKED 

SUBJECTS  1-16 

SUBJECTS  1-16 

C3 

C4 

STANDARD 

ROTATING 

CUPOLA 

SUBJECTS  1-16 

SUBJECTS  1-16 

Frelimma^_Jtesidts  -  Terrain  Reasoning  (N=12> 
itime  between  checkpoints  2-3) 

MEDIANS  BY  SIMULATION  AND  COURSE 


SIM/COIJRSE  1 

253  sec 
(R  206-999) 


SIM /COURSE  2  HTD /COURSE  1  HTD /COURSE  2 

268.5  sec.  238  sec  2213  sec. 

(R:  209-338)  (R:  173-999)  (R;  180-312) 

MEDIANS  BY  SIMULATION 

SIMNET _ HIP 

268.5  225.5 

(R:  206-999)  (R:  173-999) 

MEDIANS  BY  COURSE 
COURSE  1 _ COURSE  2 


238 

(R:  173-999) 


2333 

(R;  180-338) 


£ 

reiiminary  results  -  lerram  Keasonmg 
itime  between  dieclq>oints  1-2) 

MEDIANS  BY  SIMULATION  AND  COURSE 

SIM/COURSE  1 

SIM/COURSE  2 

HTD/COURSE  1  HTD /COURSE  2 

156  sec 

14Z5sec 

185  sec 

162.5  sec 

CR  128-207) 

(R  129-236) 

(R  127-228) 

(R  122-221) 

Mean:  161.3 

Mean:  158.8 

Mean:  175.2 

Mean:  166.0 

MEDIANS  BY  SIMULATION 

SIMNET 

HTD 

144.5 

177.5 

(R  128-236) 

(R  122-228) 

Mean:  160.1 

Mean:  170.6 

MEDIANS  BY  COURSE 

COURSE  1 

COURSE  2 

171.5 

(R  127-228) 
Mean:  168.3 


145.0 

(R  122-236) 
Mean:  162.4 


Head-Tracked  Cupola  Display  Research 
Preljinmarv  Results  -  Preference  Means  (Nr=1.^> 

Scale:  5=iinpossible,  4=difficult,  3=modeiate,  2=easy,  l=veiy  easy 
_ question _ SIMNET _ HTD 


1.)  Ability  to  perceive  locations  accurately 

3.11 

2.89 

2.)  Ability  to  identify  surroundings 

3.00 

3.00 

3.)  Ability  to  maintain  orientation  and  not 
get  lost 

3.0 

2.67 

4.)  Ability  to  acquire  targets  without  time 
constraints 

2.67 

2.67 

5. )  Ability  to  acquire  targets  imder  time  pressure 

None  of  these  results  were  statistically  significant 

6. )  Which  simulation  was  more  difficult? 

3.44 

3.00 

SIMNET=  6 
HTD=  5 

SAME=  2 

7. )  Were  there  any  feahires  about  either  simulation  that  you  especially  liked 

or  disliked? 

8. )  Which  simulation  do  you  think  would  be  the  most  beneficial  for  training? 

SIMNET=  8 
HTD=  4 

SAME=  1 

9. )  Which  simulation  do  you  prefer? 

SIMNET=  7 
HTD=  5 

SAME=  1 

10. )  Do  you  think  that  your  performance  and  preferences  would  have 
changed  if  the  head-tracked  display  did  not  have  popping/flickering? 


Yes  =  11  No  =  2 


Display  Technology:  The  1ST  Difference 
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Virtual  Environments 
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world:  2000  world:  200,000  world:  200  million 


$500k  each 

Qty  in  the 

world:  <1000  Qty  in  the  Qty  in  the 

world:  200,000  World:  200  million 


Virtual  Environments 


Projected  Milestones  -  Virtual  Reality 
(*  =  depending  on  funding) 
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1  Feb.  92  -  Specification 
1  June  92  -  Partial  Protot3rpe  Review 
15  July  92  -  Working  System,  Alpha  Tests 
1  October  92  -  In  Service  (Beta  Tests) 

<*  ~  1992  Florida  High  Tech  Council  > 


Virtual  Environments:  The  1ST  Difference 


-  1ST  Visitors 

-  VR  Conferences 


PREPARED  FOR: 


PM  TRADE 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described 
below.  The  Cost  Report  contains  both  task  by  current  and 
cumulative  cost.  The  Progress  Reports  are  by  separate  task. 

•  TASK  1:  Rapid  Production  of  Geospecific  Databases 

•  TASK  2:  Production  of  Standard  Simulation  Databases  for 

Multiple  Image  Generators 


Cost  and  Progress  Reports 
June  1991 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 
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Monthly  Report  July  1991 
Geospecific  Database  Project 
Project  Lead:  Brian  Blau 
Visual  Systems  Laboratory 
Institute  for  Simulation  and  Training 


Developments 

1.  The  proposed  meeting  of  the  research  group,  which  consists  of  Dr. 
Mubarak  Shah  of  UCF’s  Computer  Science  Department  and  Dr.  Kevin  Bouyer 
of  USF’s  Computer  Science  Department,  to  be  held  in  mid  July  was 
postponed  due  to  schedule  conflicts. 

2.  The  timelines  for  delivery  of  software  from  Dr.  Shah  and  Dr.  Bouyer  is 
being  formulated.  Their  updated  image  extraction  software  will  be  used  to 
create  the  cultural  features  for  the  demo  database  CDRL.  When  the  exact 
delivery  dates  are  known,  more  detailed  database  construction  plans  will  be 
made. 


Problems 


There  are  no  problems  at  this  time. 


Monthly  Report:  July  1991 


Project:  Multiple  Image  Generator  Databases  (MIDB) 

Project  Lead:  Curtis  Lisle 

Accomplishments:  Several  separate  efforts  are  underway  within  the  MIDB 
project.  Highlights  of  the  past  month  are  listed  below  by  category. 

1.  SIMNET  Databases:  Work  continues  on  the  SimData  Center  toolset.  A  Polygon 
Resizing  tool  was  completed  during  the  past  month.  This  tools  allows  the 
polygons  of  a  model  to  be  "stretched"  slightly  to  compensate  for  a  limitation  in  the 
BBN  GT  100  series  architecture.  A  result  of  this  is  increased  efficiency  for  model 
development  in  the  SIMNET  environment.  Also  see  #3  below. 

2.  Project  2851:  As  was  mentioned  in  last  month's  report,  work  has  begun  on  the 
formatting  program  from  P2851  GTDB  to  MultiGen.  It  will  be  written  in  Ada  on  the 
Harris  Nighthawk  computer.  The  converter  is  part  of  our  subcontract  work  for 
PRC.  This  tool  will  be  part  of  the  SimData  toolset  when  completed.  We  have  not 
yet  received  confirmation  of  our  subcontract  award  from  PRC.  Curt  Lisle  talked 
with  Gene  Clayton  (PRC)  on  July  29  and  was  told  that  IST's  proposal  was 
acceptable  to  ASD,  but  no  commitment  was  made  as  to  whether  this  option  to 
PRC’s  contract  would  be  exercised. 

3.  NOSC:  Curt  Lisle  attended  a  meeting  about  SIMNET  database  interchange 
formats  hosted  at  the  Naval  Ocean  Systems  Center  (NOSC)  on  July  18,  1991.  This 
was  a  high-profile  meeting  for  1ST.  A  trip  report  is  attached.  All  expenses  for  the 
trip  were  covered  by  NOSC. 

Problems: 
none  at  this  time 


Trip  Report 


Dates: 

Location: 


1ST  Personnel: 
Persons  Visited: 


Distribution  of  report: 

Kevin  Boner  (NOSC) 

Gene  Clayton  (PRC/Project  2851) 

Brian  Goldiez  (1ST) 

Ray  Green  (PM-TRADE) 

Dr.  J.  Michael  Moshell  (IST/VSL) 

Ernie  Smart  (1ST) 

Scott  Smith  (1ST) 

Purpose:  The  purpose  of  the  trip  was  to  attend  a  SIMNET  database 
interchange  format  meeting  at  NOSC.  Kevin  Boner  invited  several  major 
offices  involved  in  the  SIMNET  system  to  meet  in  order  to  solve  the  Navy’s 
short-term  problems  with  the  UAV  program  as  well  as  the  entire  industry's 
long-term  problem  of  database  compatibility  with  existing  SIMNET  systems. 

Meeting  Attendance:  This  meeting  was  attended  by  approximately  25 
people  including  the  following: 

Bob  Clover  (IDA) 

Alex  Gallico  (CAE  CSRDF) 

Rear  Adm.  Lee  Kollmorgen  (DARPA  Consultant) 

Farid  Mamaghani  (BBN) 

Lt.  Cmndr.  Dennis  McBride  (DARPA) 

Alan  Mitchell  (BBN) 

David  Pratt  (Naval  Post-Graduate  School) 

Richard  Sherman  (Loral) 

Rullell  Ure  (CAE  Montreal) 

Chuck  Taylor  (UAV-JPO) 


July  17-19,  1991 

Naval  Ocean  Systems  Center 
San  Diego,  CA 

Curtis  Lisle 

Kevin  Boner  (NOSC)  619-553-3558 
Tom  Tiernan  (NOSC) 


Itinerary:  July  17  and  July  19  were  entirely  spent  in  travel  between  Orlando, 
FL  and  San  Diego,  CA.  All  day  July  18  was  spent  on  site  at  NOSC.  The  entire 
group  met  between  8:00  am  and  12:15  pm  with  a  smaller  more-technical 
meeting  continuing  on  until  about  5:30pm.  I  met  with  Kevin  Boner  to 
review  the  day's  events  after  5:30pm. 


Meeting  Summary 


The  following  sections  summarize  the  major  ideas  presented  during  the 
NOSC  meeting  described  above.  Where  applicable,  the  presenter  of  the  idea 
is  mentioned. 

Tom  Tiernan  /  Kevin  Boner  (NOSC)  - 

Problem:  -  The  UAV  (Unmanned  Air  Vehicle)  program  has  a  technical  block. 
The  UAV  system  is  hooked  up  to  the  SIMNET  via  a  protocol  translator,  but 
the  UAV  CIG  (Computer  Image  Generator)  is  currently  not  a  BBN  design. 
Database  compatibility  is  the  problem.  How  does  the  UAV  program  get  the 
Hunter  Liggett  database  and  standard  SIMNET  models  on  a  non-BBN  CIG? 
Other  databases  are  desired,  also.  Can  standards  be  agreed  upon  to  make 
future  connections  to  SIMNET  less  painful? 

Farid  Mamaghani  ,  Alan  Mitchell  (BBN)  - 

Database  Development  Process:  DB  (database)  development  process  shown 
in  diagram  below.  The  SI 000  tools  do  this  process  for  BBN.  ITD  import  to 
SI 000  under  development  by  LNK  &  Army  ETL. 


Requirements 

Definition 


Source  Data 
Aquisition 


Database  Design 
(what  features 
are  important?) 


Basic  steps  to  model-building: 

1.  Create  Geometry 

2.  Build  different  LCDs  (levels  of  detail) 

3.  make  broken  versions  of  models  (destroyed) 

4.  add  color,  texture,  thermal  attributes  desired 

5.  compile  into  new  DED  (dynamic  element  database) 

6.  review  model  on  CIG 

7.  map  to  vehicle  ID  on  network  (so  network  messages  match  model) 
CIG  Limitations  to  consider  during  design: 

1 .  polygon  count 

2.  DB  complexity 

3.  model  count  in  DED 


4.  memory  capacity  /  disk  capacity  of  CIG 


SDIS  format:  BBN  created  a  public  database  format,  called  SDIS  (SIMNET 
Database  Interchange  Specification).  The  acronym  words  were  changed  to 
"Simulation  Database  Interchange  System"  recently.  The  SDIS  format  was 
originally  designed  to  support  dynamic  terrain  and  network  interface 
(transmitting  terrain  changes  across  the  network).  SEF  (SDIS  Interchange 
Format)  was  initially  an  ISO  standard  which  supported  networking  (ASN.l). 
This  was  hard  for  many  users,  so  BBN  wrote  tools  to  ease  access.  The 
Application  Program  Interface  (API)  is  available  to  help  users  get  access  to 
SDIS  databases. 

Future  work  at  BBN:  Areas  that  BBN  would  like  to  follow  include  speeding- 
up  the  API,  compatibility  between  SDIS  and  Project  2851  data  formats,  better 
automatic  extractions  of  model  and  terrain  data  from  the  SDIS  formats,  and 
importing  alternative  databases  into  the  BBN  environment  using  SDIS.  Also 
distributed  dynamic  terrain  and  inputting  intelligence  data  for  mission 
rehearsal  in  a  distributed  environment. 

BBN  would  like  to  cooperate  with  other  industry  or  government  groups  to 
follow  some  of  the  future  application  areas.  Additional  funding  will  be 
necessary  for  BBN  to  address  any  of  these  future  areas. 

Gary  Washam  (Ball  Systems  Inc.)  -  Ball  Systems  purchased  MegaTek. 
They  are  a  small  Image  Generator  vendor  now. 

Data  Formats:  Internal  to  the  company.  Ball  Systems  uses  ASF  (ASCII 
Simulation  Format)  which  is  generic  and  similar  to  MultiGen  "Flight" 
format.  (Author's  note:  1ST  is  familiar  with  "Flight"  format  and  has  current 
projects  involving  this  format).  The  following  diagram  describes  their 
internal  formats  and  their  interfaces  to  the  other  formats  in  the  simulation 
industry: 


Ball  Systems  Side: 


Industry  Side: 


Texture  maps  here 


paging 

Direct  Memory 
Access  format  - 
pre-built  Display  list 


Binary  version  of 
ASF  -  loads  faster 


Problems  with  UAV  Project:  Ball  Systems  has  no  good  way  of  getting  the 
SIMNET  databases  over  to  their  CIG  platform.  An  SDIS  translator  was  built, 
but  didn't  work  very  well.  A  small  8  kilometer  x  8  kilometer  SIMNET 
database  was  transferred  with  about  two  man-months  effort.  Ball  would 
rather  not  go  through  this  effort  again. 

Dan  Brockway  (Cambridge  Research  Assoc.)  ■  He  is  personally  doing 
most  of  the  work  with  the  Ball  Systems  CIG.  He  has  gotten  about  12  Hz 
update  rate  out  of  it  with  the  small  8k  x  8k  database.  Ball  cannot  page  in 
"load  module"  sections  of  the  database  as  the  CIG  moves  around  yet.  Ball's 
architecture  is  still  immature. 

Dave  Pratt  (Naval  Post-Graduate  School)  -  Dave  has  been  involved  in 
the  conversion  of  SDIS  format.  He's  developed  a  networked  simulator 
running  on  Silicon  Graphics  IRIS  workstations.  He  converted  SDIS  database 
and  models  to  get  data  for  his  simulator.  Strengths  of  SDIS:  flexibility  and 
generality  (it  can  hold  many  different  types  of  data);  drawbacks  of  SDIS: 
limited  to  triangles  (no  four  or  more  sided  polygons),  not  human  readable, 
some  polygons  had  normals  reversed; 

Discussion  by  the  entire  group:  The  following  topics  were  discussed  by 
the  entire  group  during  or  after  the  presentations: 

Project  2851  SIF/HDI  format  -  The  Tri-Service  Project  2851  is  specifying 
SIF/HDI  (Standard  Simulator  Database  Interchange  Format  /  High-Density 
Input-output).  This  format  is  receiving  fairly-wide  industry  participation. 
The  idea  of  the  Navy  funding  the  remaining  SIF/HDI  development  was 
discussed.  This  would  allow  the  Navy  to  drive  completion  of  the  format 
design,  making  it  serve  as  an  industry-wide  format  for  SIMNET  databases. 


George  Lukes  (Army  ETL)  was  one  of  the  strongest  advocates  of  using  the 
SIF/HDI  format. 


Using  SDIS  for  terrain  -  The  Navy  Post-Graduate  School  (specifically,  Dave 
Pratt)  offered  software  tools  to  convert  the  entire  50  kilometer  x  50  kilometer 
Hunter  Liggett  database  into  a  simple,  textual  format  which  would  be 
easier  for  Cambridge/Ball  to  use. 

Transferring  SIMNET  models  -  Between  200  and  300  models  have  been 
developed  by  BBN  for  various  SIMNET  projects.  A  standard  set  of  1 14  models 
are  installed  at  all  the  SIMNET-T  (training)  sites.  These  models  need  to  be 
transferred  over  to  the  Ball  Systems  CIG.  BBN  said  it  could  convert  models 
to  SDIS  format,  but  would  require  funding  for  this  effort.  Curt  Lisle  (1ST) 
said  1ST  had  many  of  the  models  and  could  provide  software  to  convert  them 
into  a  simple,  textual  format  (similar  to  Dave  Pratt)  with  minimal  effort. 

Final  Recommendations:  (Bob  Clover)  The  following  is  the 
recommendations  given  to  the  Navy  to  solve  the  UAV  program's  problem: 


Problem 


Solution  Responsibility 
(short  term  /  long  term) 


1.  Terrain 

A.  Getting  rest  of  50kx50k  Hunter  Ligget  NPGS/  Ball-CRA 

B.  Converting  other  SIMNET  DBs  to  SDIS  PM-TRADE  (sub  to  BBN) 


2.  Models 

A.  40+  models  already  in  SDIS 

B.  114  standard  models  converted  to  SDIS 

C.  future  models  &  building  DEDs 


NPGS 

DO  to  PM-TRADE 
(sub  to  BBN) 
CRA->ETL->LORAL  (DO) 


3.  Updating  Vehicle  Mao  PM-TRADE  /  Loral 

4.  Configuration  Mgmt.  PM-TRADE  /  Loral 

(databases,  SIOOO  software,  DEDs,  etc) 

DO  =  delivery  order 

CRA  =  Cambridge  Research  Associates 
NPGS  =  Naval  Post  Graduate  School 
ETL  =  Army  Engineer  Topographic  Labs 


Discussions  with  NOSC 


After  the  meeting  was  over,  I  had  some  additional  discussions  with  Kevin 
Boner  (NOSC).  It  seemed  that  NOSC  will  attempt  to  become  more  self- 
sufficient  for  visual  system  database  generation.  We  discussed  several 
possible  cooperative  tasks  including  model  development  and  interfacing  IRIS 
workstations  to  the  SIMNET  network.  All  of  this  was  just  talk  because  we 
don't  know  how  much  is  possible  contractually,  but  Kevin's  group  at  NOSC 
would  like  to  work  with  1ST  if  it  is  possible. 


Discussions  with  BBN 

Both  Alan  Mitchell  and  Farid  Mamaghani  expressed  interest  in  providing 
the  new  SI 000  tools  to  1ST.  I  have  since  been  in  contact  with  a  BBN  engineer 
who  is  preparing  a  tape  for  1ST.  Alan  and  Farid  will  be  in  the  Orlando  area 
in  the  next  several  months  and  would  like  to  meet  to  discuss  further 
cooperative  work  between  BBN  and  1ST.  Areas  we  discussed; 

-  XI 1  port  of  SI 000  tools 

-  SDIS  to  SIF/HDI  formatter 

-  co-development  of  SI 000  tools 


Summary 

This  was  a  high-visibility  meeting  in  the  simulation  community 
(particularly  the  SIMNET  community).  I  believe  it  was  advantageous  to 
both  1ST  and  NOSC  that  I  attended.  As  described  above,  there  are 
possibilities  of  funding  from  NOSC.  Kevin  Boner  is  planning  a  visit  to  1ST  on 
August  9,  1991.  We  will  hold  further  discussions  at  that  time. 


_ UNIVERSITY  OF  CENTRAL  FLORIDA _ 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 

1 2424  RESEARCH  PARKWAY,  SUITE  300,  ORLANDO,  FLORIDA  32826  (407)  658-5000 

PM  TRADE 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Raymond  F.  Green  AMCPM-TND-ET 

Subject:  BAA-89-01  Monthly  Progress,  Status  and  Management 

Report 

Reference:  Contract  N61339-90-C-0042 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Date:  2  August  1991 


Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced 
contract,  the  Monthly  Progress,  Status  and  Management  Reports  and 
Cost  Reports  for  Task  1  and  2  for  the  June  1991  time  period  are 
forwarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5000. 


Program  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 ;  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
November  1992 


PREPARED  BY; 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 
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Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  November  1992  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB  project.  The 
extension  to  the  MIDB  project  was  made  for  the  purpose  of  processing  a 
single  GTDB  and  a  single  SIF  database  for  display  on  the  SIMNET  IG. 

Ft.  Irwin  GTDB:  A  Ft.  Irwin  GTDB  was  received  by  1ST.  It  covers  a  one-cell 
area  containing  the  Ft.  Irwin  base  camp.  The  Ft.  Irwin  database  was 
converted  from  a  GTDB  to  the  MuItiGen  format  the  first  try  with  no 
software  changes  at  all!  Further  processing  remains  before  the  database  is 
ready  for  import  into  SI 000  (see  next  paragraph). 

MuItiGen  to  SI 000  formatter:  The  new  SI 000  assembly  tool  which  imports 
MuItiGen  format  databases  was  received  by  1ST  this  month  and  tested.  It 
imported  a  small  sample  database  but  did  not  correctly  import  the  ITSC 
database  made  of  Hunter  Liggett.  After  some  experimentation,  we  found 
that  the  SIOOO  system  imports  a  MuItiGen  flight  format  similar  to  but  not 
exactly  what  our  pipeline  produces.  The  development  of  an  additional 
conversion  tool  will  allow  us  to  process  the  Ft.  Irwin  database  onto  the 
SIMNET  during  December  and  early  January. 


Problems: 


None  at  this  time 


UNIVERSITY  OF  CENTRAL  FLORIDA 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 
1 2424  Research  Parkway,  Suite  300  ORLANDO,  FLORIDA  32826 


STEUCOM 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Raymond  F.  Green  AMSTI-EC 

Subject:  BAA  89-01  Monthly  Progress,  Status  and  Management 

Report 


Reference:  Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Date:  December  29,  1992 


Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  November  1992  time  period 
are  fowarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5014. 


Sincerely, 


Program  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
December  1992 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  December  1992  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB  project.  The 
extension  to  the  MIDB  project  was  made  for  the  purpose  of  processing  a 
single  GTDB  and  a  single  SIF  database  for  display  on  the  SIMNET  IG. 

Ft.  Irwin  GTDB:  As  was  reported  in  November,  the  GTDB  of  Ft.  Irwin  was 
received  by  1ST  and  was  converted  to  MultiGen  format  by  our  software 
successfully.  When  further  processing  was  begun  on  the  database,  it  was 
discovered  that  the  unexpanded  cultural  features  are  difficult  for  our 
conversion  software  to  process. 

Expanding  the  culture  and  planting  it  is  beyond  the  scope  of  what  a 
formatter  for  the  SIMNET  IG  from  GTDB  should  have  to  perform.  Therefore, 
we  modified  our  parameter  requrest  to  include  fragmented,  expanded 
culture  and  requested  an  additional  GTDB  from  P2851. 


Problems: 


None  at  this  time 
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CUMULATIVE  HOURS  THRU  12/31/92  5,187.25  14,705.75  19,893.00 


UNIVERSITY  OF  CENTRAL  FLORIDA 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 

12424  RESEARCH  PARKWAY,  SUITE  300,  ORLANDO,  FLORIDA  32826  (407)  658-5000 


STRICOM 

12350  Research  Parkway 


Orlando,  FL 

32826 

Attention: 

Mr.  Raymond  F.  Green  AMSTI-EC 

Subject: 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure: 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

January  29,  1993 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  December  1992  time  period 
are  fowarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5014. 


Sincerely, 


Program  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
January  1993 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  January  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB  project.  The 
extension  to  the  MIDB  project  was  made  for  the  purpose  of  processing  a 
single  GTDB  and  a  single  SIF  database  for  display  on  the  SIMNET  IG. 

Ft.  Irwin  GTDB;  As  delivered  in  the  first  GTDB,  the  cultural  features  are  in 
2D  vector  form.  The  GTDB  was  ordered  this  way  because  our  division  of 
responsibilities  between  1ST  and  BBN  included  BBN  supporting  vector 
format  import  of  MultiGen  data  into  the  SI 000  system.  They  have 
completed  the  MultiGen  import  to  SI 000  (as  previously  reported)  for 
polygonal  terrain  and  culture,  but  not  for  vector  culture.  Therefore,  complex 
custom  software  (to  expand  and  plant  culture)  would  have  to  be  used  to 
convert  the  GTDB  into  a  format  acceptable  for  SI 000. 

1ST  has  not  yet  received  the  second  GTDB  distribution  with  fragmented 
culture  from  Project  2851.  We  are  currently  looking  at  an  ADDWAMS  format 
culture  import  for  the  GTDB  vector  data  into  SIOOO. 

PRC  Lessons  Learned  Document:  A  review  was  performed,  at  STRICOM's 
request,  of  the  lessons  learned  document  produced  by  PRC  after  the  P2851 
SIF  Hunter  Liggett  gaming  area  was  used  for  the  Interoperability 
Demonstration  at  I/ITSEC  1992. 


Problems: 


None  at  this  time 
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UNIVERSITY  OF  CENTRAL  FLORIDA 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 

1 2424  RESEARCH  PARKWAY,  SUITE  300,  ORLANDO,  FLORIDA  32826  (407)  658-5000 


STRICOM 

12350  Research  Parkway 


Orlando,  FL 

32826 

Attention: 

Mr.  Raymond  F.  Green  AMSTl-EC 

Subject: 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure: 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

February  9,  1993 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  January  1993  time  period  are 
fowarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5093. 

Sincerely, 


Art  Cortes 

Visual  Systems  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY  AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR; 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO.  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
April  1993 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  April  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB  project.  The 
extension  to  the  MIDB  project  was  made  for  the  purpose  of  processing  a 
single  GTDB  and  a  single  SIF  database  for  display  on  the  SIMNET  IG. 


Ft.  Irwin  GTDB; 

Updated  parameters  for  the  GTDB  requesting  polygonalization  and 
fragmented  culture  were  given  to  PRC  (the  Project  2851  contractor).  1ST 
received  verbal  confirmation  that  two  different  GTDBs  were  contstructed  of 
the  downtown  Ft.  Irwin  area.  The  gaming  area  used  did  not  have  model 
references,  but  does  have  road  and  cultural  feature  outlines.  1ST  is 
expecting  to  recieve  the  GTDB  distributions  during  the  month  of  May  and 
continue  the  processing  for  the  SIMNET  system. 


Problems: 


None  at  this  time 
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CUMULATIVE  HOURS  THRU  4/22/93  5,187.25  15,084.00  20,271.25 


UNIVERSITY  OF  CENTRAL  FLORIDA 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 
1 2424  Research  Parkway,  Suite  300  ORLANDO,  FLORIDA  32826 


STRICOM 

12350  Research  Parkway 
Orlando,  FL  32826 


Attention: 

Mr.  Raymond  F.  Green  AMSTI-EC 

Subject: 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure: 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

May  14,  1993 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  April  1993  time  period  are 
fowarded  for  your  review  and/or  approval. 


If  you  have  any  questions,  please  contact  me  at  658-5093. 
Sincerely, 


yAit  Cortes 
Visual  Systems  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
February  1993 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  February  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB  project.  The 
extension  to  the  MIDB  project  was  made  for  the  purpose  of  processing  a 
single  GTDB  and  a  single  SIF  database  for  display  on  the  SIMNET  IG. 

Contract  Extension: 

1ST  requested  a  contract  extension  during  the  month  of  February  because  of 
the  late  delivery  of  the  GTDB  database  from  the  P2851  contractor  The 
extension  was  granted  by  STRICOM. 

BDS-D  Database  Development  Meeting: 

Curtis  Lisle  and  Art  Cortes  joined  officials  from  US  Army  STRICOM,  US  Army 
TEC,  Air  Force  ASD  (P2851),  PRC,  and  KOAN  Corp.  in  a  Army  database  policy 
meeting.  During  this  meeting,  policy  was  crafted  for  the  production  and 
validation  of  several  visual  databases  created  for  the  BDS-D  program. 

Ft.  Irwin  GTDB: 

1ST  has  not  yet  received  the  second  GTDB  distribution  with  fragmented 
culture  from  Project  2851.  Curtis  Lisle  discussed  the  status  of  that 
database  with  Jim  Sargent  of  PRC  and  Major  Johnson  of  Air  Force/ASD 
(director  of  P2851)  at  the  BDS-D  Database  Development  meeting.  Both  were 
helpful  and  pledged  that  the  database  would  be  made  available.  Adequate 
time  is  now  available  in  the  contract  for  the  remaining  database  processing. 


Problems: 


None  at  this  time 
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CUMULATIVE  HOURS  THRU  2/25/93  5,187.25  14,894.25  20,081.50 


UNIVERSITY  OF  CENTRAL  FLORIDA 


INSTITUTE  FOR  SIMULATION  AND  TRAINING 
1 2424  Research  Parkway,  Suite  300  ORLANDO,  FLORIDA  32826 


STRICOM 

12350  Research  Parkway 


Orlando,  FL 

32826 

Attention: 

Mr.  Raymond  F.  Green  AMSTI-EC 

Subject: 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure: 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

March  17,  1993 

\ 

r 

0 


Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  February  1993  time  period  are 
fo warded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5093. 

Sincerely, 


Visual  Systems  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
May  1993 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  May  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB 
project.  The  extension  to  the  MIDB  project  was  made  for  the  purpose 
of  processing  a  single  GTDB  and  a  single  SIF  database  for  display  on 
the  SIMNET  IG. 


Ft.  Irwin  GTDB: 

The  GTDB  distribution  expected  from  PRC  did  not  arrive  during  May 
as  expected.  1ST  has  made  a  request  to  get  the  distribution  from 
PRC  as  soon  as  possible  to  allow  sufficient  processing  time  once  the 
GTDB  is  received.  Two  different  databases  were  generated  over  the 
same  gaming  area  with  different  polygonal  resolutions  as  a 
comparison  experiment. 

Equipment: 

RAM  memory  expansion  for  a  workstation  used  to  support  the 
database  conversion  will  be  ordered  during  the  next  month.  The 
original  request  for  this  expansion  was  sent  via  contract  letter  on 
May  28,  1992. 


Problems: 


None  at  this  time 


UNIVERSITY  OF  CENTRAL  FLORIDA 

_ institute  for  simulation  and  training 

1 2424  Research  Parkway,  Suite  300  ORLANDO,  FLORIDA  32826 


STRICOM 

12350  Research  Parkway 


Orlando,  FL 

32826 

Attention; 

Mr.  Raymond  F.  Green  AMSTI-EC 

Subject: 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  BOOl) 

Enclosure: 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

June  15,  1993 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  May  1993  time  period  are 
fowarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5093. 

Sincerely, 


Visual  Systems  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR: 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042  (BOOl) 


BAA  89-01 


This  contract  is  broken  down  into  two  tasks  as  described  below.  The  Cost  Report 
contains  both  tasks  by  current  and  cumulative  cost.  The  Progress  Report  addresses  Task  2. 


TASK  1 :  Rapid  Production  of  Geospecific  Databases 

TASK  2:  Production  of  Standard  Simulation  databases 

for  Multiple  Image  Generators 


Cost  and  Progress  Reports 
June  1993 


PREPARED  BY: 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 

Curtis  Lisle 

Visual  Systems  Lab/IST 

Report  on  June  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB 
project.  The  extension  to  the  MIDB  project  was  made  for  the  purpose 
of  processing  a  single  GTDB  and  a  single  SIF  database  for  display  on 
the  SIMNET  IG. 


Ft.  Irwin  GTDB: 

Two  GTDB  databases  polygonized  at  different  resolutions  were 
received  from  Project  2851.  The  databases  had  been  expected  for 
several  months.  Processing  of  these  databases  will  occur  during 
July  and  August. 

Image  Trip: 

Curt  Lisle  attended  a  meeting  of  the  Special  Interest  Group  on 
Simulator  Networking  at  Tucson,  Arizona  in  coordination  with  the 
1993  meeting  of  the  Image  Society.  A  trip  report  is  attached. 


Problems: 


None  at  this  time 


Trip  Report 

Image  Society  Meeting 
June  22-24,  1993 

Curtis  Lisle,  ISTA^SL 

Purpose:  The  purpose  of  this  trip  was  to  attend  the  Image  Society  meeting  in 
Tucson,  AZ.  I  attended  the  Networked  Simulation  Special  Interest  Grouped 
(SIGNET)  headed  by  Mike  Severding  (ARINC).  Several  of  the  important  people 
in  Visual  System  Databases  were  at  this  particular  conference  in  one  of  the 
special  interest  groups. 

SIGNET  meeting 

SIGNET  purpose  :  The  SIGNET  goal  is  to  try  to  balance  issues  across  core 
technology  (DB,  IG,  display,  perception  &  human  factors).  How  does 
networking  interact  with  these  core  technologies?  Stay  away  from  protocols 
and  standard  establishment,  but  study  the  impact  of  protocols  &  standards. 

Attendees  of  STGNF.T: 

Dr.  Hoock  (ARL)  is  working  with  the  TEC  group  on  atmospheric  models.  He  said 
there  was  some  near-real  time  models  running.  He  gave  me  the  paper 
"Statistical  Texturing  Applied  to  battlefield-induced  Clouds".  Looks  very 
promising. 

Bruce  Montag  -  SW  Research  Institute.  (San  Antonio,  TX?)  WST.  (weapons 
system  trainer)  F-16  simulators  &  lantern  version.  Adding  gridded  field 
nieteorological  data  sets  into  simulators.  Sensor  simulation  coordinated  with 
visual!  DIS  atmosphere  subgroup  meeting  at  his  institute  next  month!  Digital 
meteorological  source  for  atmosphere.  Source  is  reformatted  for  real-time  use. 
Jim  Bassinger  aware  of  this.  DMSO  heard  his  presentation  &  liked  it. 

Gary  ??  -  STRICOM.  Operational  pilot  in  the  Army,  command  positions.  Moved 
to  acquisition  at  STRICOM.  Was  at  ARI  (Orlando),  two  years  ago,  assigned  to 
monitor  flight  simulators  &  ground  simulators.  Limited  networking 
knowledge,  but  senses  the  move  to  this  area.  Mentioned  Louisiana  Maneuvers. 

Judith  Pafford-  Hughes  moved  from  database  into  program  management  over 
visual  new  business  .  Hughes  bought  Rediffusion.  Systems  integrators;  don't 
build  their  own  IGs  anymore.  DIS  involvement  from  Hughes 

Pam  Woodard  -  STRICOM  for  3  weeks.  Working  on  the  "Which  simulators  can 
train  which  tasks?  What  level  of  correlation  is  needed?"  work  she  wrote  about 
will  be  continued  with  STRICOM. 

Major  George  ???-  helicopter  pilot  using  scramnet  at  Kirtland  AFB.  Trying  to 

study  the  technology  and  build  in-house  network  simulators.  Works  for  Lt. 
Colonel  Reeves  whose  presentation  is  discussed  later  in  this  report. 

Pam  Whitter  -  Visual  Systems  at  MDHC.  Was  involved  when  MDHC  was  alone  in 
their  state-of-the-art  work.  Now  building  a  simulator  using  SGI  GL 
programming  directly  in  C. 


Mike  Panzitta  -  (E&S)  IG  database  software.  A  senior  project  engineer  on  the 
CCTT  program. 

Dr.  Economy  -  (Martin  Marietta)  looking  at  networked  simulation  for  many 
different  purposes.  If  your  simulator  can’t  network,  then  you  won't  sell.  Also 
addressing  low-cost  simulators.  Delivered  product  to  SEGA  already! 

Jim  Basinger  -  AF  training.  Heads  technology  development  at  Wright 
Patterson  (not  quite  right).  Maybe  Looking  at  space  training,  too.  Sponsors 
technology  development.  UTSS  involvement.  Be  aware  of  technology  &  funnel 
the  technology  into  the  acquisition  program  for  the  AF. 

Mike  Severding  -  Was  a  pilot  in  the  AF.  Worked  in  the  AF’s  simulator 
certification  programs.  Worked  at  Wright  Patterson.  ASDA'W  (now  YT)  as  a 
program  manager.  Set  up  beginnings  of  P2851  and  UTSS. 

John  Coffee  -  GPS  technologies.  Not  a  network  person.  Media  specialist. 
Translate  technology  so  that  leadership  in  the  Navy  can  understand  it  and 
make  good  decisions. 

Mike  Sarsovich  (sp?)  -  Naval  Air  Systems  (?)  Training.  Gatekeeper  in  the 
networking  issues.  Sensitive  to  the  Navy's  needs.  It  is  his  responsibility  to 
define  the  Navy's  needs  for  networking.  Creating  an  official  position 

statement  for  the  Navy.  Must  make  sure  the  training  is  useful  for  the  fleet.  He 
said  some  of  the  trainers  the  Navy  bought  weren’t  used  fully  (all  new 
technology  may  not  be  useful).  Insure  that  the  Navy  is  going  the  right  way. 
UTSS  program.  He  is  doing  a  "selling  program"  to  the  fleet  right  now.  The 
Navy  leaders  sold  to  congress  that  they  don't  need  new  resources  to  enter 
simulation.  This  was  a  mistake  because  Navy  simulator  resources  are  now 
overcommitted. 

Tom  Bohman  -  SYSTRAN  (Scramnet)  which  is  a  high-speed  networking  layer. 
He  has  marketed  the  simulation  industry.  Also  used  within  a  simulator  (host  to 
IG,  etc.).  Where  can  networking  be  used? 

Dr.  Hoock  -  ARL  (was  Atmospheric  sciences  laboratory)  trying  to  get  weather 
&  atmospheric  effects.  Zero  to  300m  elevation  is  the  most  imporant.  Wind  & 
terrain  coupling.  Fidelity  on  smoke  plumes  vs.  capability. 

Lt.  Col  Ed  Reeves 

AT  Kirtland,  hi-fi  simulators,  database  generation  capability.  Combat  training 
has  always  been  a  group  activity  since  the  caveman.  Warfare  is  a  group 
activity.  "Joint  warfare"  is  buzzword  in  the  forces  right  now.  The  Colonel  has 
been  responsible  for  much  of  the  progress  of  the  lab  at  Kirtland. 

training — Observation _ center  -  six  role  playing  stations,  forty  watchers.  Audio 

is  their  biggest  problem  when  trying  to  do  coordinated  exercise.  Tremendous 
problems  as  you  go  over  wide  area  networks  (transport  delays).  Based  on  Mult- 
Sim  experiments  at  Ft.  Rutger.  The  Army  papers  written  in  88  and  89  helped 
him.  They  support  SOF  and  search  &  rescue  training.  Using  the  room:  class  in 
training  is  on  the  6  role-playing  stations,  beginning  classes  watch  the 


advanced  ones  under  training.  All  video  is  recorded  and  timestamped. 

Fulcrum  digital  map  system  is  used  to  locate  all  simulators  Instructer  has 
"John  Madden"  capability  (can  draw  over  the  graphics  on  the  screen  during 
after-action  review.  Rader.  NVG,  FLIR  (forward  looking  infared)  supported  on 
the  weapons  systems.  Correlation  needed  for  8  channel  display, 
GPS/Doppler/Inertial  navigation  using  all  these  sensors!  Multi-sensory 
correlation. 

**  you  must  solve  the  correlation  problem  on  a  non-networked  system  before 
attempting  networking! 

German  Toronodo  program  used  least-common-denominator.  The  visual 
system  database  polygons  were  converted  &  installed  in  DRLMS  to  get 
correlation.  The  Col.  has  lawn  furniture  in  the  MH-53J  weapons  system 
because  lawn  furniture  hits  rotor  blades  when  the  helicopter  flies  too  close.  If 
you  choose  the  least  common  denominator,  then  you  are  not  a  weapons  system 
trainer  (WST),  you  are  just  an  operational  simulator. 

**  source  data  is  very  important.  "Smart  net"  data  network  supports 
everything  by  connecting  the  DBGS  systems  and  the  engineers  fixing  the 
flight  models  (on  suns)  together.  Software  moves  transparently  across  the 
stations.  Multiple  levels  of  security  must  work  simultaneously  on  the  network. 
FDDI  and  security  switches  used. 

Jim  Bassinger's  talk: 

SNAP  -  Simulation  Network  Analysis  Project.  Involves  Pax  River.  Idea  is  to 
build  a  capability  to  test  the  timing  of  a  single  simulator,  networked  simlators, 
or  an  end-to-end  test  of  a  full  system.  Tie  into  a  variety  of  places  into  the 
simulator  ("When  did  the  display  actually  change")  ,  "when  did  the  data 
actually  come  out  on  the  network").  Timestamps  are  added  to  all  states  as  they 
are  recorded.  Timestamps  are  based  on  timing  signals  from  the  GPS  satellites. 
All  hardware  is  currently  in-place,  software  integration  in  process.  Hope  for 
some  demonstration  by  Fall  93.  GPS  believed  to  be  accurate  to  the  microseconds 
granularity.  Only  a  couple  thousand  dollars  if  you  just  want  to  get  timestamps 
from  GPS.  You  put  a  satellite  antenna  on  your  roof. 

**  GPS  could  be  a  good  way  to  get  absolute  time  for  DIS  simulators. 

SNAP  records  analog  signals  or  digital  data  (read  off  computer  busses,  or  at  an 

output  port  fired  by  a  flag  from  the  simulation  software).  The  simulator  would 
be  in  a  special  testing  mode,  not  in  general  training  mode.  It  is  supposed  that 

the  time  delays  in  the  SNAP  system  itself  have  been  considered.  Data  analysis 

provided  for  post-processing.  This  seems  like  a  very  experimental  program.  I 
wonder  if  it  will  be  prove  useful.  No  plans  for  incorporating  this  against 
flight  crews  yet.  They  are  planning  to  deliver  this  to  SOFATS  for  use  to 
evaluate  SOF's  systems.  Want  to  use  SNAP  with  WarBreaker  phase  2.  Contact 
for  SNAP  is  Ron  Ewart,  WL/FIGD,  Wright-Patterson,  (513)  255-4690.  The  system 
is  designed  to  be  transportable  (two  people  carrying  it).  Maybe  the  DIS  testbed 
should  get  one  of  these  as  an  ultimate  datalogger? 

phase  1 :  local  simulator,  stick  to  visual  system,  stick  to  host. 

phase  2:  pax  river  involved.  sim#l  to  sim#2  perception  time,  delay  as  a 

function  of  network  load  measurements. 


Bruce  Montalk,  Southwest  Research  Institute: 

Gridded  field  weather  database  which  can  support  the  environmental  effects  to 
distributed  IGs,  DRLMs,  and  host.  Correlation  is  assured  by  being  generated  in 
a  single  place  (not  really,  but  a  single  source  helps). 

Prototyped  on  SGI  Crimson  Reality  Engine.  NightHawk  doing  6-DOF  (forces  on 
airframe)  and  SGI  RE  (visual  display).  Model  National  Center  of  Atmospheric 
Research.  JAWS  (Joint  Airport  Weather  ?)  database  used.  Gridded  field.  Each 
node  has  temperature,  pressure,  wind  velocity  vector,  moisture  content.  Very 

large  storage.  Today  each  simulator  is  using  their  own  database.  Using  200 
meter  source  data,  resampled  to  400  meter  spacing  for  use.  Temporal  updates 
are  done  at  a  2  minute  interval.  Mark  IVB  takes  DMSP  data  and  produces  grid 
field  databases.  SOOnm  x  800nm  into  2048  points  in  each  of  15  layers.  DMSP  is 
a  satellite  which  is  taking  real  time  weather  information  (meteorilogical  data). 
Underlying  accurate  basis  for  effects.  DMSP  updates  slowly.  Doppler  position 
is  updated  every  2  minutes.  ETAC  (envin.  tech,  applic.  center  in  AF)  they  take 
satellite  data  and  extrapolate  into  the  gridded  field  data  used  for  their 
prototype.  Mobile  systems  can  do  conversion  within  an  hour.  Idea  is  not  to  get 
exact  data,  but  to  have  "representative"  weather. 

Planning  to  merge  vector  data  into  the  gridded  field  representation. 

The  output  of  database  processing  is  an  abstract  geometry  representation  sent 
to  the  IG  (higher  than  polygons).  Requires  the  IG  to  have  an  integrated  scene 
management  allocating  polygons  for  different  features.  THIS  IS  DONE  AT  EACH 
SIMULATOR. 

"ASEL  range  format".  Environmental  PDU  planned  here.  Focus  of  architecture 
to  maintain  and  work  with  the  GF  (gridded  field  )  datatype. 

600  weather  parcels  /  field  of  view  /  frame  rate  in  prototype  system.  WEST 
server?  Temporal  interpolation  is  quite  a  problem.  The  prototype  doesn't  do 
temporal  interpolation;  the  weather  is  snapshotted  at  a  single  instant  in  time. 

Bruce  is  in  contact  with  the  NRL  Monterey  group  which  is  meeting  for  EEDIS 
(Environmental  Effects  in  DIS)  with  USA  CERL  in  Wash.  DC  July  1  and  2.  Bruce 
used  their  source  database. 


SIGNET/CIGSIG  joint  meeting: 

fading  function  discussion.  Mike  Severding  raised  the  issue  that  most  vendors 
used  fading  functions  based  on  a  single  formula,  but  had  customized  it  for 
their  implementation.  Could  some  standardization  be  found?  Could  IG  vendor 
representatives  find  out  how  much  they  can  talk  about  without  violating  their 
proprietary  rights?  Vendors  agreed  to  cooperate. 

Ron  Matusof  (CAE  Link): 

Very  direct  presentation  about  the  major  problems  which  must  be  overcome  in 
networked  simulation.  Slide  showing  the  intervisibility  problem.  Slide 
showing  you  can't  navigate  in  one  coordinate  system  and  Just  convert  your 


coordinates  when  indicating  your  position  (you  will  not  be  traveling  the  same 
amount  of  distance).  The  math  derivation  which  Mike  faxed  earlier  to  1ST 
covers  this.  Time  delay  on  the  network  will  become  a  serious  problem, 
especially  as  we  move  to  Wide  Area  networks  with  greater  delays. 


Dr.  Economy,  Martin  Marietta: 

Computations  must  be  done  for  texture  on  both  visibilc  and  invisible  objects, 
(i.e.  tree,  smoke,  and  building  behind).  Dumb  depth  buffers  don't  know  to  stop 
when  the  pixel  is  full.  A  smart  Z-buffer  can  be  difficult  depending  on  the  IG 
architecture. 

**  IGs  can't  interoperate  if  they  have  different  pixel  visit  capacities  because 
they  will  degrade  differently.  Also  imperoperability  problems  because  some 
may  share  frame  2,  some  may  not  (different  degradation  again). 

Regular  vs.  irregular  triangle  polygonization  will  cause  disagreements  (i.e. 
water  profile  will  be  different  because  of  the  constraints  of  regular  triangles). 
Problem  is  worse  because  the  lake  will  get  elevation  (from  underlying 
ground)  —  the  water  flowing  uphill  problem. 

Correct  terrain  LOD  should  keep  the  average  density  per  vertical  angle 
constant.  He  is  arguing  that  terrain  blending  doesn't  work  becase  of  the 
terrain-following  problem  during  the  blending  range.  Mission  critical 
features  could  be  weighted  so  they  biend  down  less  drastically. 

Load  management  is  hard  enough  in  a  standalone  IG.  Load  managment 
becomes  a  real  problem  in  a  networked  simulation. 

**  picture  of  two  simulations  where  the  fade  LOD  has  violated  the  fair  fight. 
Problem  because  tanks  blend  out  later  than  trees  (mission  critical  problems). 

In  a  muIti-LOD  terrain  system,  models  may  be  sitting  on  different  terrain  LODs 
than  what  is  being  displayed  by  any  watching  simulator's  IG. 

Load  managment  has  a  direct  impact  on  interoperability. 

Mission  functions  are  embedded  in  the  image  generator  (because  the  host 
couldn  t  do  them  —  too  much  computation),  as  the  number  of  models  increases, 
this  load  will  increase  (from  todays  40%  of  load).  Harder  as  weather  models  are 
added. 

Dynamic  terrain  and  dynamic  environment  effects  the  performance  of 
mission  functions.  Must  start  simulating  the  physics  of  the  3D  environment. 
Rendering  will  shrink  as  a  portion  of  the  problem.  Mission  functions  will 
dominate  the  cost  of  IGs..  Mission  function  ASICs? 

Shadows  -  some  limited  dynamic  shadows  can  be  done,  but  this  is  special 
effects.  True  shadowing  is  not  ready  yet.  Only  "first  level"  shadows  work.  NVG 
uses  the  shadows.  Transitioning  between  shadow  sets.  C-130  uses  an  IR 
spotlight  at  night  and  needs  shadows  for  detecting  where  the  target  is. 

**  database  will  be  more  closely-coupled  with  the  IG  in  the  future. 


ATM:  small  packets  with  600  Megabits  /  second  throughput.  Adjust 
wordlength  (Asynchronous  transfer  medium??)  works  through  twisted  pairs. 
For  sale  today.  Any  size  packets?  Very  fast  hardware  to  sense  gaps  in  the 
network.  EE  times  has  ads  for  it.  If  this  is  true,  it  could  revolutionize  network. 

Tom  Bohman,  SYSTRAN: 

SCRAMNET  is  used  on  a  lot  of  simulation  systems.  SCRAMNET  supports 
replicated  shared  memory  between  portions  of  a  distributed  real-time  system. 
Memory  connection  is  established  between  the  CPUs.  Whenever  any  computer 
changes  a  value  in  any  global  memory  location,  the  SCRAMNET  boards 
communicate  with  zero  bus  bandwidth  in  the  host.  transport  delays  between  2 
and  4  microseconds.  This  only  works  for  local  areas.  It  can  be  extended  up  to 
about  25  kilometers.  150  Mbits/sec,  65Mbyte/sec. 

Wide  area  networks  are  a  problem.  DIS  requires  addressing  WAN  (for  example, 
satellite).  Shared  memory  doesn't  work  here  because  of  transport  delays. 

Univ.  of  Illinois,  The  Cave,  uses  SCRAMNET  to  connect  the  four  different  IGs 
together  on  the  four  sides  of  the  cube.  The  IGs  are  GenLocked  together  so  their 
right  and  left  eyes  are  coordinated.  All  users  are  wearing  LCD  shuttered 
glasses.  Control  data  was  transmitted  using  SCRAMNET.  "swapbuffers"  had  to 
be  done  at  same  time  on  all  IGs  (within  a  few  microseconds). 

Throughput,  transport  delay,  determinism,  payload  size  per  packet,  CPU 
overhead,  scalability,  how  many  different  CPU  types,  synchronization 
capabilities.  All  these  are  measures  of  merit.  How  do  we  prioritize  this  list  for 
individual  tasks. 

Future  capability:  Current  version  of  scramnet  still  available  for  lower  cost  in 
five  years.  >  100  MByte/second  throughput  available.  Mapping  function  so 
that  all  global  data  doesn't  have  to  be  sent  (didn’t  understand  this).  Memory 
mapped  interrupts  &  triggers  already  exists,  it  may  be  improved.  Triggers  can 
be  generated  due  to  changes  on  a  particular  memory  location. 

ATM:  63  byte  packets  and  it  is  a  wide-area  network.  It  is  a  protocol  which  sits 
upon  lower  protocols.  Packet  switched  approach.  He  believes  that  there  is 
more  work  to  be  done"  with  ATM  before  it  is  a  solid,  reliable  network 
substrate. 

General  discussion  of  interest  to  DT: 

Environment  server  -  in  DIS  there  is  not  a  server.  DIS's  basic  rules  prohibit 
the  server.  There  is  no  central  information  repository.  Several  members 
believe  the  "no  central  repository"  idea  is  going  to  go  away  or  have  allowed 
exceptions.  Atmospheric  &  weather  effects  will  force  this  to  change  -  it 
would  make  more  sense.  Vote  was  for  a  DT  server  to  handle  the  ground 
changes.  The  opinions  I  solicited  on  the  "need  to  know"  property  for  the  DTSU 
were  all  in  favor  of  removing  that  requirement  (simulators  decide  to  keep  it  or 
throw  it  away).  Positive  feedback  from  Ron  (CAE)  about  the  distinction 
between  "in-process"  pdus  and  "final  shape"  PDUs  for  a  certain  feature.  This 
way,  some  simulators  can  ignore  "in  process"  DT  features  but  merge  them  into 
the  database  when  they  reach  their  final  form. 


SIGNET  only  meeting 


Anti-aliasing  issues:  A  new  vendor  (Tulorian?)  has  a  non-antialiased  system 
with  high  capacitiy  for  a  low  price  (8k  polygon  system  for  $48k  ).  This  has 
effective  price/performance,  therefore  it  will  have  some  systems  fielded  with 
it.  Dr.  E  said  that  their  low-performance  (no  anti-A)  has  bad  dissolve  into  the 
distance.  It  can  actually  give  you  bad  queues.  You  keep  your  eyes  focused  in 
closer.  Ron  (CAE  )  was  at  Atari  and  he  said  that  you  had  bad  queues. 

CCTT  has  stringent  anti-aliasing  requirements.  If  they  play  against  non- 
antialiased  systems,  the  "Kell"  factor  will  be  wiped  out.  Dr.  E  presented  the 
problem  of  vertical  bands  alternating  black  and  white.  As  you  back  away,  that 
feature  will  become  all  white  or  all  black  and  will  scintillate  between  the  two. 
MTF  was  used  as  a  measure. 

***  problem  to  determine/specify  the  "performance  characteristics"  of  a 
system  without  forcing  a  particular  design  (especially  in  Government  RFPs). 
For  example,  say  "good  enough"  anti-aliasing  not  "4x4  subpixel  smoothing". 

We  didn't  reach  a  conclusion  on  how  to  address  this  problem.  Texture  anti¬ 
aliasing  is  amore  critical  problem  because  polygon  interiors  cover  larger 
screen  area  (more  pixels)  than  the  edges.  Edge  smoothing  usually  defeats 
sensors  because  the  target  is  smooth  and  the  background  has  crawling  texture. 

Texture  will  continue  to  be  in  the  IGs  of  the  future.  Prediction  of  increased  use 
and  capability.  Martin's  SEGA  system  had  texture  anti-aliasing  but  didn't  have 
edge  anti-aliasing.  Even  when  they  could  offer  $20  more  for  edge  anti¬ 
aliasing,  SEGA  didn't  want  the  extra  cost. 

Action;  Raise  question  with  the  DIS  group  at  1ST  whether  1ST  can  propose  an 
anti-aliasing  experiment.  Texture  and  edge  smoothing  vs.  some  particular 

scenarios.  Try  to  figure  out  how  to  make  it  relevant  to  RFPs  and  trainer 
capability. 

opinion:  Caligraphics  are  losing  market  share.  They  will  continue,  but  the 

amount  of  market  requiring  them  will  shrink.  Needed  for  Navy  landing  on 

ships  or  short  runways.  Higher  resolution  raster  can  replace  calligraphics  in 

some  applications  (more  as  resolution  increases).  Use  a  "Snelling  factor"  (eye 

chart)  to  determine  overall  system  viewpoint.  This  visual  acuity  requirement 
could  be  specified  at  a  different  level  by  each  customer. 

Handicapping:  Dr.E  raised  the  issue  some  simulators  being  handicapped  to  try 
to  compensate  for  the  visual  anomalies  in  IGs.  This  opens  up  a  dangerous 
potential  for  negative  training.  DIS  approach  currently  is  that  DIS  will  not 
correct  for  unequal  IGs.  Drastically  different  simulators  shouldn't  be  allowed 
to  apply.  The  Colonel  said  that  we  need  to  educate  the  senior  leaders  about  the 
problems  or  they  will  have  unrealistic  expectations.  View  that  there  are  too 
many  variables  buried  into  this  problem.  Handicapping  must  be  done  by 

adjusting  some  system  parameter  (size  of  target,  visual  range,  anti-aliasing, 
etc.).  Requires  mapping  of  system  "adjustments"  to  the  desired  handicap! 

(must  be  developed,  yet). 

**  given  enough  data  (after  several  years  of  operational  use?),  controlled 
handicapping  seems  to  have  some  use. 


DIS  compliance:  Must  be  refined  more  to  be  useful.  We  don't  know  what  "DIS 
compiant  means  -  no  definition  has  been  made.  A  better  question  is  "must  be 
interoperable".  Ron  (CAE)  said  that  several  good  people  are  analyzing  this 
problem  to  determine  levels  of  compliance  or  levels  of  capability  needed.  May 
take  several  years  before  a  good  answer  is  ready,  though. 

Gamma  correction:  measure  at  the  displays.  It  doesn't  matter  where  its  done. 
CIE  color  matching  must  be  done  at  the  output.  Need  to  measure  at  multiple 
brightnesses. 

Celeste  Howard:  offered  1931  CIE  metrics  for  color  definitions  for  measuring 
consistencies.  Get  away  from  RGB  (not  perceived  in  the  eye  this  way).  IF 
eveiybody  is  consistent  in  CIE  space,  then  we  are  comparing  contrast  and 
luminance  values.  She  is  preparing  a  color  proposal  for  common  objects 
(trees,  color,  sky,  etc.).  Need  equipment  for  measuring  color  coordinates  or 
radiometric  values  (Minolta  makes  one  of  these).  Dr.  Economy  brought  up  that 
gamma  correction  is  required  to  prevent  hue  shifting  as  the  display  device 
intensity  is  changed.  Dr.  E  believes  that  CIE  values  cannot  replace  gamma 
correction  because  of  this  problem.  Old  AVTS  system  (GE)  doesn't  have  gamma 
correction  to  match  the  current  CompuScene  series.  In  Celeste's  approach,  a 
separate  lookup  table  is  developed  for  each  display  device  on  the  IG. 
Interoperability  is  assured  by  exchanging  CIE  values  for  features  in  the 
database,  not  RGB  (which  requires  gamma  tweaking  of  display  devices). 

Gamma  correction  definition  -  A  function  to  keep  each  color  gun's  perceived 
intensity  consistent  as  brightnesses  is  changed.  No  hue  shifts  occur.  (Dr. 

Economy). 

The  group  decided  that  Celeste's  approach  should  be  adopted.  Requirements 

should  be  made  in  CIE  measurements  off  the  display  systems. 

IGs  working  in  CIE  space:  Question  raised  about  image  generators  using  CIE 
internally  and  converting  to  RGB  on  output  only.  Dr.  Economy  mentioned  that 
PT-2000  used  YIQ  internally  for  some  operations  and  said  that  a  matrix 
multiplication  would  be  added  on  the  output  to  convert  from  YIQ  to  RGB. 
Discussion  of  multipliers  vs.  color  lookup  table  to  do  this  conversion.  Color 
table  would  be  very  large. 

Recommendations  by  SIGNET  to  the  whole  group: 

1.  DIS  should  recommend  standard  CIE  values  for  certain  colors.  Don't  tweak 
your  display.  Color  of  interchanged  objects  will  be  represented  in  CIE  space. 

2.  P2851  should  output  databases  in  CIE  values.  SIF  supports  HSV  and  RGB 
outputs  today.  Celeste  didn't  like  HSV.  She  said  it  was  old  and  obsolete. 

Joint  meeting  on  6/24/93 

presentation  by  Kirtland  AFB  Colonel.  They  have  spent  a  lot  of  time  and 
energy  to  create  a  sophisticated  DB  generation  capability  using  Martin 
Marietta  s  TARGET.  Developed  several  large,  government  owned  databases. 
Releasing  these  as  SIF  to  P2851.  Source  data  fusion  and  registration  of  multiple 


sources  had  to  be  tracked  carefully.  They  are  interoperating  between  several 
high-fidelity  simulators  using  their  own  networking  implementation. 

**  DIS  design  team  should  connect  with  networking  people  at  Kirtland  in 
order  to  get  lessons  learned.  Particularly  networking  of  control  info  (radio, 
audio,  etc.).  Look  at  AF's  exercise  control  protocol  and  compare/constrast  with 
new  2.0  PDUs  for  exercise  control. 

MD  training  systems  presentation: 

definition  of  correlation  -  correlation  is  a  measurable  correspondence  among 
sensor/visual  CIG  outputs  ,  simulated  systems  outputs,  and  the  real  world. 

Level  of  fidelity  is  an  important  simulator  measure  which  must  be  taken  into 
account  (picture  comparing  two  cartoon  scenes  where  objects  were  moved  or 
missing). 

Sensor  types  -  visual  OTW,  nav  FLir,  tgt  FLir,  dig  map,  TC/TF  display,  flight 
control,  radar,  NVG,  low-light  TV  sensors. 

How  do  you  observe  the  correlation?:',  correspondence,  recognition  of  things, 
location  &  size  of  things,  perspective  &  aspect  of  models,  time  synchronization 
of  moving  models. 

Level  of  detail  correlation  must  be  addressed  by  the  DB  generation  and  the 
simulator  must  fade/swap  LCDs  in  a  known  way. 

polygon  vs.  gridded  -  Radar  is  usually  high  density  gridded.  If  the  source 
database  was  polygonal,  you  get  harsh,  artificial  polygon-shaped  shadows. 
Radar  imagery  looks  like  low  sun-angle  shaded  terrain  B&W  profiles.  Since 
the  profile  is  the  most  important  thing,  high  density  is  a  driving  requirement. 

1st  step  of  correlation  -  provie  corrrespondence  among  entitties,  objects 
represented  by  the  outputs  of  high-performance  simulators  on  DIS  network. 
Then  go  to  lower-fidelity  after  that. 

Future  vision:  direct  conversion  of  live  imagery  from  sensors  driving  the 
simulators.  Database  production  problem  will  go  away,  but  in  the 
meantime. ..databases  should  be  constructed  from  fused  source  imagery. 

Minimize  the  modeling  steps.  Model  only  what  you  MUST  model,  but  your 
development  cost  will  go  up.  He  showed  a  picture  of  three-band,  interactive 
(pseudo  realtime)  feature  classification  from  LandSat/SPOT  imagery. 

Supervised  classification  algorithm  was  used.  Reached  85%  classification 
accuracy.  Neural  network  algorithm  used. 

**  issue  raised:  standardized  outputs  which  can  be  measured  against  to  verify 
that  a  simulator  database  is  "verified"  could  be  agreed  upon.  This  concept 
seems  like  the  "right  numbers  coming  out  of  the  metric  suite  which  was  run"... 

compared  -  texture  height,  features  height,  etc...  (missed  rest  of  the  list). 
Implemented  a  14kilo  x  14kilo  database  on  the  Vidal-7  IG  (textured). 


Results  were  presented,  but  the  scale  of  the  results  was  not  explained.  The 
results  have  been  returned  to  P2851  in  their  final  report. 

Recommendations: 

•  implement  a  common  DIS  environemt  database  for  all  simulators,  (use 

SIF/HDI). 

•  Agree  on  correlation  definition  &  specification  for  simulators. 

•  Develop  quantitative,  automated,  and  rapide  correlation  testing  tools  from 

common  and  CIG  databases  (elevations,  features,  models,  texture). 

•  drive  database/CIG  developments  by  correlation  performance. 

SIGNET  Action-item  suggestions: 

SIG  members  provide  ideas  on  correlation  development.  Definition,  metrics, 
and  survey  the  sate-of-the  art. 

•  Make  a  Benchmark  database  for  minimum  aceptable  IG  performance  to  be 

provided.  DIS  performance  specification.  If  we  are  measuring  with  real 
vehicles  in  the  real  world  (via  GPS),  then  the  benchmark  must  be  the  real 
world!  Issue  raised  that  this  wouldn't  work  for  all-one-IG  network.  Seemed 
like  only  the  DB  group  liked  this.  Dr.  E  suggested  that  SIMNET  was  an  example 
of  this  already  and  the  "all  same  database"  didn’t  help  any  in  terms  of  reaching 

correlation  in  a  heterogeneous  network.  It  seems  that  there  may  be  use  for  a 

"benchmark  database",  but  we  didn't  reach  a  final  conclusion  here. 

•  On-line  DB  generation/transformation.  Provide  a  parametrized  (GTDB  or  SIF) 
DB  which  can  be  used/queried.  (this  wasn't  mentioned). 


Really  fast  DT  presentation: 

Curt  gave  a  ten  minute  talk  on  the  DT  program,  the  basic  architecture,  and  the 
lessons  we  were  expecting  to  learn  from  the  prototype.  Explained  that  results 
would  be  presented  at  the  DIS  conferences.  No  time  was  available  for 
questions. 


UNIVERSITY  OF  CENTRAL  FLORIDA 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
1 2424  Research  Parkway,  Suite  300  ORLANDO,  FLORIDA  32826 


STRICOM 

12350  Research  Parkway 


Orlando,  FL 

32826 

Attention; 

Mr.  Raymond  F.  Green  AMSTI-EC 

Subject; 

BAA  89-01  Monthly  Progress,  Status  and  Management 
Report 

Reference: 

Contract  N61339-90-C-0042  (CDRL  COOl) 

Enclosure; 

Cost  and  Progress  Reports  for  Visual  Database 

Date: 

July  19,  1993 

Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly  Progress, 
Status  and  Management  Report  and  Cost  Report  for  Task  2  for  the  June  1993  time  period  are 
fowarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5093. 

Sincerely, 

Art  Cortes 

Visual  Systems  Manager 


STATE  UNIVERSITY  SYSTEM  OF  FLORIDA 


AN  EQUAL  OPPORTUNITY/ AFFIRMATIVE  ACTION  EMPLOYER 


PREPARED  FOR; 


STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


CONTRACT  N61339-90-C-0042 


COST  AND  PROGRESS  REPORTS 
FOR 

JULY  1993 


PREPARED  BY; 

INSTITUTE  FOR  SIMULATION  AND  TRAINING 
UNIVERSITY  OF  CENTRAL  FLORIDA 
12424  RESEARCH  PARKWAY 
ORLANDO,  FL  32826 


Progress  Report 

Project  2851  GTDB/SIF  Processing 
Curtis  Lisle 

Visual  Systems  Lab/IST 
Report  on  July  1993  Activities 

This  report  summarizes  the  progress  on  the  ECP  to  the  MIDB 
project.  The  extension  to  the  MIDB  project  was  made  for  the  purpose 
of  processing  a  single  GTDB  and  a  single  SIF  database  for  display  on 
the  SIMNET  IG. 


Ft.  Irwin  GTDB: 

Two  GTDB  databases  polygonized  at  different  resolutions  were 
received  from  Project  2851.  The  databases  had  been  expected  for 
several  months.  Processing  of  these  databases  will  occur  during 
July  and  August. 

The  databases  have  been  read  by  the  IST-written  GTDB-to-MultiGen 
converter.  The  gaming  area  datasets  have  been  converted  to 
MultiGen  polygonal  format  at  the  time  of  this  report.  Further 
processing  into  the  run-time  format  for  the  SIMNET  IG  is  continuing 
into  August. 

We  are  planning  to  complete  the  conversion,  the  documentation  of 
the  conversion  effort,  and  the  software  documentation  as  the  last 
tasks  on  this  contract. 


Problems: 


None  at  this  time 
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STRICOM 

12350  Research  Parkway 
Orlando,  FL  32826 

Attention:  Mr.  Ray  Green 

Subject:  Monthly  Progress,  Status  and  Management  Report 

Reference:  Contract  N6 1 3 3 9-90-C-0042 

Enclosure:  Cost  and  Progress  Reports  for  Visual  Database 

Date:  19  August  1993 


Dear  Mr.  Green: 

In  accordance  with  the  requirements  of  the  above  referenced  contract,  the  Monthly 
Progress,  Status  and  Management  Report  and  Cost  Report  for  the  July  1993  time  period 
are  forwarded  for  your  review  and/or  approval. 

If  you  have  any  questions,  please  contact  me  at  658-5093. 

Sincerely, 


